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FOREWORD 


The  Curriculum  and  Evaluation  Team  in  the  Instructional  Technology  Sys¬ 
tems  Technical  Area  of  the  U.S.  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences  (AR1)  performs  evaluation  and  curriculum  development  with 
applicability  to  military  education  and  training.  Of  special  interest  is  the 
formative  evaluation  of  a  pilot  program  on  the  teaching  of  learning  strategies 
at  Fort  Knox,  KY.  Because  learning  strategies  training  is  seen  as  a  potential 
solution  to  some  of  the  cognitive  skill  deficits  that  prevent  certain  soldiers 
from  succeeding  in  the  Army,  it  is  essential  to  conduct  a  comprehensive  evalu¬ 
ation  of  such  training. 
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EDGAR  M.  JOHNSON 


Technical  Director 
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FORMATIVE  EVALUATION  OF  AN  ADAPTATION  OF  THE  FEUERSTEIN  INSTRUMENTAL 
ENRICHMENT  PROGRAM  IN  THE  U.S.  ARMY  BASIC  SKILLS  EDUCATION  PROGRAM 
(BSEP  II) 


EXECUTIVE  SUMMARY 


Requirement : 

Large  numbers  of  American  youths  leave  the  education  system  lacking  the 
knowledge  and  basic  skills  needed  to  function  effectively  in  careers.  The 
Army  has  accepted  many  of  these  youths  with  the  expectation  that  they  will 
develop  the  necessary  skills  in  the  context  of  an  Army  career.  To  address 
these  needs,  the  Army  developed  the  Basic  Skills  Education  Program  (BSEP). 

In  addition  to  defici  ocies  in  specific  skills  such  as  reading,  language 
arts,  and  computation,  t.eie  are  more  general  deficiencies  in  underlying 
cognitive  skills  or  leai  'ing  strategies — problem  definition,  analytical  think¬ 
ing,  and  systematic  planning,  for  example.  The  U.S.  Army  Training  Develop¬ 
ments  Institute  of  the  Training  and  Doctrine  Command  (TDI ,  TRADOC)  adapted 
the  Instrumental  Enrichment  (IE)  Program  developed  by  Israeli  psychologist 
Reuven  Feuerstein'  for  a  demonstration  at  Fort  Knox,  KY ,  to  teach  such  cogni¬ 
tive  skills  to  soldiers.  The  current  research  was  undertaken  with  the  intent 
of  providing  a  comprehensive,  formative  evaluation  of  this  demonstration. 

Procedures : 

The  procedures  used  in  chis  formative  evaluation  included  observations, 
interviews,  and  cognitive  tests.  Pre-  and  post-measures  on  soldiers  included 
standardized  tests  (Armed  Services  Vocational  Aptitude  Battery  (ASVA1) ,  and 
Test  of  Adult  Basic  Education  (TABE)),  commanders'  ratings,  and  an  A  I/AIR- 
developed  test  of  cognitive  functioning  based  partly  on  Feuerstein's  instru¬ 
ments.  Before  and  after  the  demonstration,  assessments  were  taken  of  ade¬ 
quacy  of  teacher  training  and  of  teachers'  reactions  to  IE.  Before  instruc¬ 
tion,  ARI/A1R  conducted  a  comprehensive  review  of  the  IE  materials  adapted 
for  Army  use.  During  instruction  a  number  of  measures  were  used — teachers' 
records  of  student  exposure  to  IE,  attendance  records,  student  performance 
on  IE  materials,  teachers'  self-evaluations,  and  AR1/A1R  structured  observa¬ 
tions.  BSEP  cycles  from  November  1981  through  April  1982  were  involved  in 
the  demonstration  and  the  evaluation. 


Findings : 

As  exnected,  students  improved  their  reading,  language  arts,  and  compu¬ 
tation  sk  is  during  the  BSEP  cycle,  as  measured  by  the  "'BE.  However,  these 
gains  were  not  related  to  gains  either  in  general  cognitive  skills  or  in  spe¬ 
cific  abilities  to  perform  IE  exercises.  In  fact,  scores  on  Organization  of 
Dots,  the  IE  instrument  on  which  greatest  gains  occurred,  were  not  correlated 
with  the  scores  on  the  TABE  or  with  General  Technical  (G'i)  scores  on  the 
ASVAB.  Thus,  it  appears  that  tills  particular  adaptation  of  IE  addressed 

vii 


skills  different  from  those  needed  for  short-term  gains  in  standardized  tests. 
The  Army's  adaptation  of  IE  showed  low  fidelity  to  Feuerstein's  original  pro¬ 
gram.  Therefore,  from  this  demonstration  it  is  not  possible  to  assess  defini¬ 
tively  the  potential  of  IE  for  improving  soldiers'  performance  either  on 
standardized  tests  or  on  the  job.  The  demonstration  did  show  the  need  for 
improvements  in  both  teacher  training  and  materials,  and  the  need  for  a  greater 
amount  of  classroom  time  for  the  adaptation  to  be  more  faithful  to  the  original 
model  and  to  be  more  effective. 


Utilization  of  Findings: 

The  information  generated  by  this  demonstration  and  its  evaluation  by 
ARI/AIK  has  been  shared  in  written  and  oral  forms  with  other  parts  of  ARI  and 
the  Department  of  the  Army  involved  in  examining  IE  for  Army  use.  New  instru¬ 
ments  developed  for  the  evaluation  have  been  given  to  current  users  and  are 
also  available  in  the  report.  With  regard  to  utilization,  the  most  important 
aspects  of  the  evaluation  are  the  findings  concerning  proper  and  effective 
implementation  of  a  program  of  this  type  in  an  Army  setting. 
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Large  numbers  of  American  youths  leave  the  educational  system  lacking  the 
basic  knowledge  and  skills  they  need  to  function  effectively  on  the  job.  The 
'JS  Army  accepts  many  of  these  youths  with  the  expectation  that  they  can 
acquire  the  necessary  skills  for  job  success.  To  address  these  needs,  the 
Army  developed  the  Basic  Skills  Education  Program--BSE?  I  for  soldiers  in 
basic  training,  and  BSEP  II  for  soldiers  who  have  completed  AIT  or  OSUT. 

In  addition  to  deficiences  in  reading,  writing,  and  computing  skills, 
soldiers  exhibit  more  general  deficiencies  in  underlying  cognitive  skills. 
Teaching  these  cognitive  skil ls--of ten  called  learning  strategies--requires 
methods  different  from  those  used  for  teaching  reeding,  writing,  and 
computation.  One  comprehensive  method  is  the  Instrumental  Enrichment  (IE) 
Program  developed  by  Israeli  psychologist  Reuven  Feuerstein  (198O). 

The  IE  Program  consists  of  a  set  of  14  "instruments"  or  exercise  booklets 
that  can  be  used  to  teach  basic  cognitive  skills,  such  as  problem  definition, 
analytical  thinking,  systematic  planning,  systematic  searches,  perceptual 
precision,  end  leerning  processes.  These  instruments  have  been  used 
successfully  with  culturally  deprived  adolescents,  leading  to  increased  scores 
cn  standard  tests  (reuersteir.,  ibOO).  The.-  were  particularly  successful  ir. 
producing  long-term  rather  then  immediate  rams. 

To  examine  IE  in  the  context  of  STEP,  the  Army  funded  an  exploratory 
demonstration  project  at  Port  Knox.1  Because  the  instruments  were  originally* 

1 

'The  Army  Training  Developments  Institute  provided  funding  to  Curriculum 
Development  Associates  to  develop  the  demonstration  and  to  Eattelle  to  conduct 
a  preliminary  evaluation  (Rosinger,  y.yers,  &  Levy,  1?82).  The  Amy  research 
Institute  requested  the  American  Institutes  for  Research  to  conduct  a  mere 
extensive  evaluation  of  the  demonstration  program  under  s-  contract  for  as., 
overall  BSE?  evaluation.  '  .  .  . 


designed  to  be  used  in  a  longer  two-year  program  and  with  a  younger 
population,  their  use  in  BSEP  II  required  adaptation. 

Description  of  the  Instrumental  Enrichment  Program 

Reuven  Feuerstein  based  the  IE  program  on  his  experiences  of  core  than 
twenty  years  with  Israeli  adolescents  who  were  retarded  in  their  intellectual 
performance;  they  had  had  limited  opportunities  to  learn,  disrupted  lives,  and 
diverse  cultural  backgounds.  He  worked  with  the  Youth  Aliyah,  the  agency 
responsible  for  the  integration  of  Jewish  children  in  Israel.  These  children, 
some  from  primitive  cultures  in  Asia,  Africa,  and  Europe,  were  classified  and 
schooled  for  citizenship  in  a  modern,  technological  society.  A  variety  of 
tests  had  been  used  as  the  basis  for  classification  and  planning  of  schooling, 
but  these  tests  only  measured  what  the  children  had  learned,  not  what  they 
could  learn. 

Feuerstein  developed  a  sensitive  test  of  basic  cognitive  functions  that 
affect  learning,  the  Learning  Potential  Assessment  Test,  and  the n_ transformed 
the  test  into  a  training  device.  Eventually  he  developed  the  IE  program  "to 
change  the  overall  cognitive  structure  of  the  retarded  performer  by 
transforming  his  passive  and  dependent  cognitive  style  into  that 
characteristic  of  an.  autonomous  and  independent  thinker"  (Feuerstein,  1960, 
p.l).  This  approach  assumes  that,  "cognitive  modifiability"  can  occur  through 
mediated  learning  experiences  as  well  as  through  direct  exposure  to  sources  of 
stimuli. 

According  to  Feuerstein,  retarded  cognitive  performance  results  when  the 
essential  products,  of  a  culture  are  not  transmitted  to  an  ind-ividua  1,  leaving 
the  person  "culturally  deprived."  Such  a  person  exists  In  a  state  of  reduced 
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cognitive  nod i r iabil 2 rv ,  even  kten  directly  exposed  to  sources  of  stimulation, 
because  he  or  she  does  not  possess  the  cognitive  functions  to  assimilate  the 
situation.  Furthermore,  he  proposed  that  cultural  deprivation  does  not  result 
directly  from  distal  determinants,  such  as  genetic  factors,  organicity,  level 
of  environmental  stimulation,  and  socioeconomic  status.  Rather,  there  is  a 
crucial  proximal  determinant,  lack  of  mediated  learning  experiences,  that 
causes  inadequate  cognitive  development.  The  distal  determinants  operate  by 
causing  the  lack  of  mediated  learning  experiences. 

According  to  Feuerstein's  theory  of  mediated  learning  experiences, 
retarded  cognitive  performance  is  a  reversible  condition.  The  necessary 
intervention  can  be  undertaken  at  any  age  and  is  directed  at  eliminating 
deficient  functioning.  This  is  accomplished  by  providing  mediated  learning 
experiences  structured  according  to  the  individual's  needs.  Students  work  on 
content-free  exercises,  and  teachers  care'fully  attend  to  the  students' 
responses  to  overcome  blocks  and  to  facilitate  generalization  of  acquired' 


skil Is . 


The  IE  program  rejects  direct  training  for  routine  mechanical  skills. 
Instead,  it  aims  "to  develop  in  the  organism  a  state  of  modifiability" 
(Feuerstein,  1980,  p.7Q).  This  permits  the  individual  to  function  and  adapt, 
to  a  normal  environment,  so  that  the  need  for  long-term' continuing  remedial 
programs  is  eliminated.  While  the  IE  program  was  developed  for  use  with 
adolescents,  Feuerstein  claims  that  "tne  underlying  principles  of  the  program 
are  applicable  to  all  ages"  (Feuerstein,  I960,  p.  6  9).  .  • 


Rationale  for  Use  of  IE  in  BSEP 

BSEP  exists  within  the  Army  Continuing  Education  System  (ACES).  This 
system  supports  and  develops  the  individual  in  four  ways: 


o  By  enhancing  the  soldier's  professional  development,  military 
effectiveness,  and  leadership  abilities 
o  By  preparing  soldiers  for  positions  of  greater  responsibility 
in  the  Army  * 

o  By  preparing  soldiers  for  productive  post-service  careers 
o  By  increasing  soldiers'  self-esteem  and  motivation  for  continued 
learning . 

BSEP  concentrates  on  developing  the  skills  of  Army  recruits  and  other 
soldiers  who  demonstrate  low  levels  of  reading  and  math  skills.  It  was 
designed  "to  develop  educational  competencies  required  for  a  soldier's  job 
performance,  skill  qualifications,  and  career  growth"  (Army  Regulation  No. 

t 

621-5).  It  provides  on-duty,  job-related  basic  skills  development: 

o  To  Increase  the  likelihood  of  good  performance  by  the  soldier  in 
training  and  on  the  job 

o  To  improve  the  soldier's  capability  of  functioning  effectively  in 
the  Army  community 

o  To  increase  the  soldier's  potential  for  pursuing  and  completing 
other  educational  and  training  programs. 

BSEP,  therefore,  is  an  enabling  rather  than  a  supplementary  program;  ir. 
prepares  soldiers  to  learn  from  the  regular  training  programs. 

Because  the  BSEP  focus  on  teaching  learning  strategies  appears  to  be 
consistent  with  the  goals  of  the  IE  program,  the  Army  funded  the  exploratory 
demonstration  project  at  Fort  :<nox  to  determine  the  feasibility  ani  value  of 
IE  in  the  context  of  BSEP. 

Feuerstein  (1980)  identified  22  cognitive  functions,  anc- Link  (1981) 
evaluated  the  BSEP  II  population  at  Fort  Knox  to  identify  cognitive  functions 
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with  the  greatest  deficiencies.  Os  the  basis  of  this  needs  assessment,  Lin): 
selected  parts  of  nine  of  the  14  15  instruments  for  adaptation  for  3SEP  use  in 
a  shortened  15  program: 

o  Organization  of  Dots--Dots  to  be  organized  into  geometric  figures 
o  Orientation  in  Space  I--0’ojects  and  symbols  to  be  located  in  space  arc 
in  relation  to  one  another,  using  left,  right,  front,  and  beck 
o  Comparisons — Use  of  pictures  and  words  to  compare  two  items  on 
discrete  dimensions 

o  Analytic  Percep tion--Geone trie  forms  used  to  teach  the  analysis  of  a 
whole  into  its  component  parts,  the  relationship  between  the  parts, 
the  viewing  of  each  part  as  a  whole  unto  itself,  and  the  possibility 
of  uniting  the  parts  into  new  wholes 

o  II lust rat ions- -Col lection  of  pictorial  situations  depicting  problems  . 
that  must  be  defined  and  solved 

o  Ins  true  t  ions --Verbal  instructions  to  be  read  and  carried  out 
o  Categorization-- 1  terns  that  are  verbal,  pictorial,  figural,  and 
schematic  to  be  organized  into  categories 
o  Nuraencel  Progression- -Pictorial,  numerical,  end  graphical  items  usee 
to  develop  the  need  to  perceive  disparate  objects  and  events  es  being- 
linked  in  a  relationship  that  car-  be  deduced 
o  Orientation  in  Space  III--Picture  and  word  problems  usc-d  tc  determine 
the  orientation  of  an  object  directly  or  as  inferred  from  knowledge  of 
the  internal  relationship  between  north,  south,  eest,  enc  vest  and  .  • 
their  positions  relative  to  one  another. 


It  should  be  emphasised  that  in  nost  cases,  the  instrument  "content"  is  nereiy 
a  medium;  the  teaching  objectives  concern  processes  such  as  planned  problem 
solving,  attention  to  cues,  organization,  and  comparison.  Each  instrument 
consists  of  approximately  thirty  pages,  and  each  page  contains  from%one.te 
twenty  problems  to  be  solved.  An  accompanying  teacher's  manual  specifies 
objectives,  subgoals,  end  procedures  for  using  each  page  of  problems. 

Descripton  of  Demonstration 

The  demonstration  involved  nine  experienced  teachers  end  118  BSEP  II 
students  in  the  training  cycle  that  began  on  9  November  1981 ,  six  of  the  nine 
teachers  and  44  students  in  the  training  cycle  that  began  on  4  January  1982 
(including  23  students  continuing  from  the  previous  cycle),  and  six  teachers 
and  47  students  in  the  cycle  that  began  on  1  March  1982  (including  17  of  the 
47  students  continuing  from  the  previous  cycle).  The  teachers  received 
instruction  from  two  master  teachers  during  three  three-  to  five-day  sessions 
during  August  and  September  1981 ,  and  they  experimented  with  some  of  the  IE 
instruments  in  their  classes  between  August  and  October  1981  . 

The  nine  teachers  were  employed  by  a  nearby  community  college.  They  were 
certified,  although  not  necessarily  in  the  subject  area  that  they  were 
teaching.  They  taught  soldiers  in  three  seventy-minute  periods  each  day,  five 
days  a  week,  for  either  six-  or  1 2-week  sessions  during  the  November- December 
cycle  and  for  either  eight-  or  i 6 -week  sessions  during  the  Jar.uary-7 ecruary 
and  March- April  cycles.  Students  with  especially  low  CT  and  TA2E  scores  were 
assigned  to  12-  or  16-week  cycles;  students  with  higher  sco'res  were  assigned 
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to  six-  or  eight-week  cycles.  All  instruction  took  piece  or.  most,  curing  on- 
duty  time,  in  or  near  the  post's  Education  Center. 

The  nine  teachers  can  be  considered  in  three  groups.  Two  of  these  groups 
actually  functioned  as  three- teacher  teams,  covering  English,  math,  and 
science;  students  moved  from  teacher  to  teacher  in  seventy-ninute  periods. 

One  of  the  teams  taught  the  students  in  the  i 2-  or  1 6-week  cycles  during  their 
first  six  or  eight  weeks.  The  other  team  taught  these  students  during  the 
second  half  of  their  cycle,  and  also  taught  those  enrolled  for  only  six  or 
eight  weeks.  These  two  teams  implemented  the  IE  program  throughout  the  entire 
period  of  the  demonstration.  They  will  be'  referred  to  as  Team  1  and  Team  2. 

It  should  be  emphasized  that  because  these  two  teams  were  ad'  ssing  different 
skill  objectives,  they  could  not  be  compared  with  each  oi  <. . 

The  remaining  group  of  three  teachers  had  students  for  the  entire  three 
hour  period--one  English-as-a-Second-Language  (ESL)  teacher,  one  basic  reading 
teacher,  and  one  Ceneral-Educational-Development  (CED)  teacher.  They  will  be 
referred  to  as  Team  3 •  These  teachers  began  by  implementing  IE,  but 
discontinued  the  program  after  December.  The  ESL  and  basic  reeding  teachers 
believed  that  their  students  required  prerequisite  skills  of  English 
comprehension  and  reeding  ability  prior  to  involvement  in  the  program. 
Furthermore,  they  felt  that  IE  instruction  would  be  redundant  because  some  of 
the  soldiers  in  these  classes  eventually  would  move  into  the  classes  taught  by 
the  Team  1  and  Teem  2  teachers.  The  GZD  teacher  felt  that 'the  pressures  of 
preparing  for  the  G.ED  examination  prohibited  spending  time  on  IE.  .  • 

There  were  several  practical  reasons  why  a  control  group  could  not  be 
used  in  this  study,  although  GT  and  other  scores  can  be  compared  with  scores’ 
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from  a  Jail  I960  cycle-  frying  tc  divide  one  teacher’s  classes  between 
treatment  and  control  (a  within-teacher  conparison)  would  be  questionable, 
because  the  IE  techniques  such  as  bridging  and, teaching  systematic  planning 
behavior  actually  constitute  a  teaching  style  and  are  diffioult  to  suppress 
once  acquired;  therefore,  ar.v  test  of  impact  would  be  diluted  by  the  teacher’s 
use  of  the  IE  methods  with  the  control  students.  Selecting  one  of  the  two 
three- teacher  teams  as  a  control  (a  between-teaa  comparison)  would  suffer  froo 
the  fact  that  these  teachers  did  communicate  with  each  other^  anc  any  IE 
effect  would  be  likely  to  spread.  Finally,  treatment  differences  would  be 
completely  confounded  with  teacher  differences  and  with  student  prerequisite 
ability  differences. 

As  an  alternative  to  a  true  experimental  design  with  a  control  group,  a 
quas i-experimental  design  was  used.  Campbell  and  Stanley  (1963)  ricognize  the 
one-group  time-series  design  as  providing  useful  information,  particularly  if 
one  maintains  accurate  records  of  the  historical  variables  affecting  the 
results.  Such  a  design  employs  periodic  measurements  to  determine  the  effects 
of  an  experimental  operation.  In  the  present  study,  this  design  was  extended 
to  include  two  parallel  teaching  teams  using  IE  and  provided  a  measure  of  the 
variation  in  effectiveness  of  IS  in  the  hands  of  different  teachers  as  well  as 
a  mean  level  of  effectiveness.  However,  because  this  evaluation  focused 
primarily  on  the  problems  encountered  in  IE  program  implementation,  any 
conclusions  that  might  be  drawn  from  comparisons  of  group  gains  would  be 
Inappropriate.  In  future  IS  program  evaluations,  a  carefully  selected  control 
group  would  provide  such  additional  information. 

The  IE  program  demonstration  that  was  conducted  in  the  context  of  ongoing 
activities  at  Fort  Knox  was  affected  by  four  administrative  £hd  procedural 
problems.  First,  it  became  clear  by  December  that  the  teachers  were 
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dissatisfied  with  the  implementation  schedule.  One  of  the  trainers  and  an  A I  it 
staff  member  worked  with  the  teachers  to  revise  both  the  program,  by  reducing 
the  required  nuaber  of  pages  per  instrument, -and  the  teaching  load,  by 
assigning  certain  teachers  to  teach  certain  instruments.  Second,  some 
soldiers  who  returned  from  previous  cycles  had  already  done  certain  IE 
exercises j  but  all  of  the  exercises  were  new  for  the  enteri soldiers. 

Third,  the  Army  contract  with  the  community  college  was  due  for  renewal  in 
November,  and  the  proposal  was  due  in  February.  In  March  the  teachers  learned 
that  the  community  college  had  lost  the  contract.  Thus,  their  future 
employment  was  uncertain.  Fourth,  the  teachers  felt  that  their  primary' 
responsibility  was  to  help  the  soldiers  raise  their  CT  or  CED  scores  in  the 
short-term — not  "to  change  the  overall  cognitive  structure  of  the  performer  by 
transforming  his  passive  and  dependent  cognitive  style  into  that  •  . 

characteristic  of  an  autonomous  and  independent  thinker"  (Feuerstein,  1980, 
p.l).  It  is  important  that  the  demonstration  data  be  interpreted  in  the 
context  of  all  four  of  these  contingencies. 

Issues 

Given  the  context  of  BSE?  in  which  IE  was  to  be  evaluated,  two  questions 
had  to  be  considered: 

o  Are  there  deficiencies  in  soldier  job  performance  that  can 
be  traced  to  deficiencies  in  cognitive  functioning? 

o  Can  IE  training  help  to  remove  these  de f ic iences ,  and  .  • 

thus  result  in  g3ins  in  soldier  performance? 
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Since  both  of  these  questions  nust  be  add  ressed  indirectly,  a  model  of 
the  IE  demonstration  was  developed.  At  the  simplest  level,  we  can  assume  that 
completion  of  the  IE  program  leads  to  proficiency  in  cognitive  skills.  If 
there  were  initial  deficiencies,  IE  should  lead  to  gains  in  performance  as 
assessed  by  appropriate  tests.  This  simple  model  is  depicted  in  Figure  1. 

This  model  is,  however,  incomplete.  The  IE  program,  like  any  other 
educational  program,  is  heavily  dependent  upon  the  effectiveness  of  its 
implementation.  This  effectiveness  is  affected  in  turn  by  three  factors — 
class  time  and  other  resources,  the  program  materials,  and-  the  teacher 
preparation  in  the  new  program.  Class  time  and  other  resources  are  determined 
by  the  design  of  the  BSEP  program  (for  example,  total  number  of  classroom 
hours)  and  by  the  design  of  the  IE  program  (for  example,  total  number  of 
classroom  hours  required).  The  adequacy  of  the  design  of  the  IE  program  for 
BSEP  also  affects  the  acceptability  of  the  IE  materials  for  an  adult 
population  and  the  effectiveness  with  which  a  shorter  implementation  period  is 
used.  The  design  of  the  IE  program,  particularly  the  teacher  training 
sequence,  as  well  as  the  teachers'  prior  skills  and  experiences,  affect  the 
level  of  teacher  preparation  to  use  IE.  This  expanded  model  is  showm  in 
Figure  2. 


10 


For  r. 


12 


Figure  2.  Kxpandvd  model  of  the  Implementation  of  IK  In  BSI3P  II  at  Fort  Knox. 


However,  student  gains  in  cognitive  skills  do  not  depend  solely  upon  the 
treatment  implementation.  If  they  are  not  motivated  to  learn,  cr  if  they  lack 
certain  prerequisite  skills,  the  treatment  nay  be  ineffective.  .M though  IE  is 
designed  to  require  few  prior  skills,  the  actual  nanifestation  of  gains  on 
criterion  tests  nay  involve,  for  example,  English  language  reading  abilities 
not  covered.  Therefore,  gains  due  to  IE  may  not  be  measurable  for  ESI. 
students  or  for  students  with  extremely  low  reading  achievement. 

The  fully  expanded  version  of  the  IE  demonstration  model  that  includes 
several  additional  factors  is  shown  in  Figure  3«  The  factors  outlined  with 
solid  lines  have  been  measured  and  are  di-s‘cussed  in  this  report.  The  two 
factors  outlined  with  broker,  lines  have  not  been  measured;  both  were  beyond 
the  scope  of  this  process-oriented  evaluation.  However,  these  factors  are 
important  from  the  standpoint  of  implementing  IE  in  ESEP.  Unless  gains  in  • 
cognitive  skills  and  learning  strategies  actually  result  in  gains  in  soldier 
performance,  the  Army  cannot  expect  a  reasonable  return  on  its  investment  in 
the  program.  Thus,  further  research  is  needed  to  determine  the  actual 
relevance  of  the  cognitive  skills  taught  by  IE  to  Army  job  performance. 

Using  this  model,  the  two  broad. issues  initially  considered  can  be 
expanded  into  a  series  of  subordinate  issues  focusing  specifically  on  the  Font 
Knox  implementation.  The  first  question,  regarding  deficiencies  in  soldier 
performance  traced  to  deficiencies  in  cognitive  functioning,  car:  be  examined 
in  two  parts: 

o  Were  there  deficiencies  in  any  of  Feuerstein's  22  cognitive  .  • 

functions  among  BSE?  soldiers? 

o  Were  these  cognitive  functions  relevant  to  performing  Amy  tasks? 
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The  first,  of  these  subquestions  was  addressed  by  Link  in  her  needs 
assessment  report.  (Link,  1981).  She  identified  the  following  deficiencies  as 
most  prominent: 

o  Difficulty  in  discovering  and  projecting  the  relationship 
between  two  items 

o  Lack  of  constancy  or  conservation  of  sice,  shape ,  and 
orientation  in  space 

o  Cognitive  impulsivity--info rmit ion  is  not  reviewed  systematically 
o  Failure  to  recognize  need  for  precision, 
o  Inadequate  strategies  for  checking  one's  work 
o  Difficulty  in  spatial  and  temporal  sequencing  and  lack  of 
labels  to  describe  spatial  orientation 
o  Difficulties  in  both  structural  and  operational 
analysis — disembedding  or  locating  and  identifying 
simple  elements  from  within  a  larger  organized  field 
o  Lack  of  spontaneous  comparative  behavior--tendency  to 
itemize  and  describe  rather  than  compare  two  objects 
o  Inattention  to  detail,  impulsive  problem  definition,  and 
unsystematic  planning  behavior 
o  Lack  of  logical  thinking  r.o  help  in  decision-maki ng . 

Wnile  the  second  of  the  subquestions  cannot  be  answered  completely,  r.he 
evaluation  prepared  by  Rosinger,  Myers,  and  Levy  (1932)  for  the  Army  Training 
Developments  Institute  attempted  to  address  the  issue  of  gains  in  soldier 
performance  on  the  job  as  the  result  of  participation  in  BSD?  and  IK 
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training .  Titty  reported  that  substantial  and  significant  gains  appeared  In 
supervisor  ratings  of  pre-  and  post-BSEP  job  performance  both  In  the  total 
score  and  in  the  following  subscales: 

o  Confidence  with  mental  activities 

k  1 

c  Planning 

o  Working  independently 
o  Concentration 
o  Spatial  orientation. 

The  results  from  this  study  should  be  qualified,  however.  Because  the 
gains  resulted  from  regular  BSEP  training  as  well  as  from  IE  training,  it  was 
not  possible  to  isolate  the  effects  of  IE.  Of  greater  concern  was  the  method 
used  to  gather  the  data.  The  post-BSEP  measures  were  obtained  from 
supervisors  about  six  ueeks  after  the  soldiers  had  completed  BSEP  but  tne  pre- 
BSEP  measures  were  collected  onLy  one  day  earlier.  These  pre-BSEP  measures 
were  in  fact  retrospective  reports  of  soldiers'  behavior  prior  to  entering 
BSEP.  The  problems  resulting  from  this  procedure,  which  was  used  because  of 
tine  and  schedule  constraints,  were  recognized  by  Rosinger  et  al  (  1  982). 

The  primary  objective  of  the  present  study  was  to  address  the  second 
initial  question,  concerning  the  extent  to  which  IE  training  results  in  gains 
on  the  cognitive  functions,  with  regard  to  the  cognitive  deficiencies 
identified  by  Link  (1981).  because  the  purpose  of  this  study  was  not  only  to 
measure  gains,  but  also  to  identify  the  sources  of  effectiveness  and  points 
for  potential  improvement  in  effectiveness,  it  was  necessary  to  record 
measures  of  implementation  and  intermediate  goal  achievement.  A  number  of 
specific  subquestions  were  addressed: 
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o 


Were  there  sufficient  class  time  and  other  resources  to 


adequately  implement  the  abbreviated  IE  program  for  all  of 
the  cognitive  functions?  If  not,  could  some  specific 
constraints  of  the  BSEP  program  or  the  IE  program  be 
modified  appropriately? 

o  Were  the  materials  appropriately  adapted  for  Army  use  in  BSEP? 
Would  it  help  to  have  more  examples  that  are  more  obviously 
related  to  Army  tasks?  Were  the  materials  internally  consistent? 
What  changes  would  be  most  effective  in  improving  the  instruments 
for  use  in  BSEP? 

o  Were  teachers  adequately  prepared  for  teaching  the  IE 

program?  Did  they  know  the  purpose  of  each  iesson,  did  they 
use  the  teacher's  manual,  and  had  they  mastered  the  required 
techniques  such  as  bridging  and  interpreting  student 
difficulties?  Was  the  teacher  training  method  used  in  the 
Fort  Knox  demonstration,  consisting  of  three  three-  to  five-day 
workshops  and  practice  for  approximately  six  weeks,  sufficient? 
Was  more  direct  focus  on  the  manual  and  teaching  methods  needed? 

o  Did  the  students  have  the  necessary  prerequisite  skills  to 
be  able  to  benefit  from  the  IE  treatment?  If  not,  were 
these  prerequisite  skills  identified  and  steps  taken  to 
train  soldiers  in  these  skills? 
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o  Do  srudents  actually  work  through  the  exercises?  If  not,  is 
it  because  of  attendance  problems,  because  of  lack  of  classroom 
tine  allocated,  or  because  of  ootivatibnal  problems — do  students 
become  turned  off  by  the  apparent  ease  of  some  of  the  problems,, 
or  by  the  apparent  irrelevance  to  rheir  personal  goals  for 
BSE?  participation? 

o  Do  students  generalize  the  skills  learned  beyond  the  specific 
context  of  the  IE  instruments — for  example,  is  IE  more  to 
them  than  connecting  the  dots?  If  not,  can  this  be  remedied 
by  further  teacher  training  in  IE,  or  is  it  better  remedied 
by  further  development  of  the  instruments? 

The  objectives  of  the  BSE?  program  at  Fort  Knox  had  been  to  improve 
language  arts,  reading,  mathematics,  and  science  skills,  as  measured  by 
the  ASVAB  and  the  TABE.  The  IE  intervention,  with  its  separate  skill 
objectives,  was  installed  within  the  existing  BSEP  program  with  the  intention 
that  BSEP  program  objectives  would  not  be  sacrificed.  Since  addition  of  the 
IE  exercises  necessarily  decreased  the  amount  of  time  spent  on  BSEP 
activities,  whatever  academic  gains  were  identified  included  the  compensating 
effects  of  IE. 

But  gains  in  academic  skills  are  not  the  ultimate  objective  of  BSEP.  The 
program  teaches  skills  important  for  a  high  level  of  job  performance.  It  is 
here  that  the  IE  cognitive  functions  are  also  more  important,  since  IE  inrends 
to  foster  problem-solving,  learning,  and"  decision-making  skills  as  well  as 
improving  the  student's  self-image  as  a  problem  solver.  Therefore,  measures 
of  Amy  job  performance  must  also  be  assessed.  Because  this  is  difficult  to 
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do  in  a  short-term  study,  t lie  conclusions  reached  should  be  rechecked  during 
the  next  r.wo  years  to  assess  lasting  ef feces. 


PROCEDURES 


General  Approach 

The  approach  to  the  evaluation  of  the  Fort  Knox  BSEP  implementation  of 
Instrumental  Enrichment  (IE)  was  entirely  formative.  That  is,  the  basic 
objective  in  collecting  data  from  observations,  interviews,  and  tests  (as 
presented  in  the  21  tables  in  Appendix  A)  was  to  identify  potential  problems 
in  the  use  of  IE  in  the  Army  and  to  recommend  appropriate  solutions. 

As  a  result  of  this  approach,  it  was  possible  to  extract  more  information 
relevant  to  Army  decision-making  than  would  have  been  possible  through  a  less 
flexible  evaluation  design.  Changes  wre  made  only  wnen  significant, 
immediate  problems  occurred,  and  these  inputs  can  be  replicated  in  future 
implementations.  Any  contamination  effect  should  be  weighed  against  the 
potential  loss  due  to  a  failure  to  immediately  make  a  needed  implementation 
process  change.  For  example,  development  of  examples  of  class  lessons 
bridging  from  IE  to  subject  matter--that  is,  relating  one  to  the  other — was 
based  on  requests  from  the  teachers,  and  this  may  or  may  not  have  influenced 
the  implementation.  (Examples  of  three  of  these  lessons  are  shown  in  Appendix 
B.) 

In  fact,  there  were  many  problems  with  this  implementation  for  which 
Immediate  solutions  were  unavailable.  Recommendations  Include  changes  in 
design  for  future  adaptations  of  IE  for  use  in  the  Army  that  should  se  rv.e  to- 
solve  these  problems. 
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Data  Sources 


A  number  of  sources  of  data  were  used  In  this  evaluation.  They  included 
archived  records  of  scores  for  both  the  students  In  the  demons t rat  ion  and  a 
cohort  from  one  year  earlier,  teachers  in  the  project,  students  in  the 
project,  the  two  IE  teacher  trainers,  the  teachers'  supervisor,  the  adapted  IE 
materials,  and  classroom  observations. 

The  data  collection  activities  are  described  in  three  categories — prior 
to  instruction,  during  instruction,  and  following  instruction. 


Measures  Taken  Prior  to  Instruction 


The  data  collection  for  the  cycles  scheduled  from  November  1981  through 
April  1982  involved  pre-measures  on  soldiers,  measures  of  teacher  IE 
preparation,  and  measures  of  the  adequacy  of  the  adaptation  of  materials. 

Pre-measures  on  soldiers.  Standardized  tests  were  used,  including  the 
General  Technical  (GT)  composite  of  the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB).  A  Test  of  Adult  Basic  Education  (TABE) ,  generally  designed 
to  be  grade  equivalent  and  customarily  administered  by  the  community  college 
as  a  part  of  BSEP,  was  also  used.  These  measures  served  to  assess  the 
contribution  of  IE  to  the  achievement  of  standard  BSEP  objectives.  Similar 
sets  of  scores  on  the  students  in  the  fall  and  winter  1980' cycles  were 
retrieved  from  files. 
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functions  identified  in  Link's 


The  soldiers  were  also  tested  on  cognitive 
needs  assessment  (Link,  1981 ).  This  vas  done  by  using  a  combination  of  two 
tests--exercises  selected  from  the  IE  instruments,  end  items  developed  to 
measure  the  functions  in  Array  contexts.  Because  of  scheduling  difficulties, 
these  tests  could  not  be  prepared  for  administration  at  the  beginning  of  the 
November  1981  cycle.  They  were  administered  in  the  middle  and  at  the  end  of 
that  cycle,  and  they  were  used  for  the  pretests  and  posttests  in  the  January- 
April  1982  cycles.  These  tests  were  administered  by  the  BSE?  teachers.  The 
IS  Test  adapted  from  IE  materials  by  the  research  staff  is  included  in 
Appendix  C;  the  Cognitive  Skills  Test,  als’o  developed  by  the  research  staff, 
is  included  in  Appendix  D. 

Measures  of  teacher  IE  preparation.  Assessments  were  requested  of  the  • 
teacher  trainers  and  of  the  teachers'  supervisor  regarding  the  extent  to  which 
the  teachers  were  prepared  for  using  IE  exercises  and  were  motivated  to  use 
them.  These  requests  focused  on  an  evaluation  of  the  teachers'  IE  preparation 
rather  than  a  more  global  evaluation  of  the  teachers  in  order  to  pronote  their 
cooperation. 

Teachers  were  also  asked  for  self-83sessments  regai..  ’  preparation,  and. 
the  depth  of  their  understanding  of  the  objectives  of  a  'sample  of  the  IE  units 
to  be  taught. 


Measures  of  the  adequacy  of  the  adaptation  of  materials.  The  materials  . 
provided  to  the  teachers  were  examined  by  the  project  staff  to  identify 
problems  in  consistencies  and  to  suggest  possible  improvements.  Participating 
teachers  were  also  asked  to  identify  problems  with  the  materials. 
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Measures  Taken  During  Instruction 


The  prinary  purpose  of  data  collection  during  the  instructional  period 
was  to  identify  sources  of  any  problems  that  occurred,  end  to  develop 
recommendations  for  improvements  that  might  be  made  in  a  replication  of  the 
demonstration  or  in  further  development  of  IE  as  e  BSE?  strategy.  The  sources 
of  the  data  needed  were  the  IE  instruments  as  completed  by  the  soldiers, 
teachers'  records  of  dates  on  which  exercises  were  administered,  attendance 
records,  and  observations  of  classroom  instruction. 

The  classroom  observations  were  conducted  by  one  or  two  researchers.  The 
first  observations  were  conducted  jointly ‘in  October.  The  remaining 
observations  in. November  and  April  were  conducted  by  one  observer,  and  those 
in  December  and  February  by  the  other.  Uo  systematic  differences  appeared  in 
the  data  reported  by  the  two  observers.  A  copy  of  the  Classroom  Observation 
Form  is  included  in  Appendix  E. 

Measures  Takep  Following  Instruction 

Measures  taken  following  instruction  were  virtually  identical  tc  these 
gathered  prior  to  instruction,  with  the  exception  of  the  analysis  of  the 
materials.  Teacher  preparation  as  veil  as  student  performance  were 
reassessed,  to  determine  whether  greater  gains  might  be  expected  in  a. 
replication  of  the  demonstration  due  to  greater  teacher  familiarity  with  the 
materials  and  their  use,  ana  whether  the  summer  cycle  training  was  sufficient 
or  whether  an  expanded  training  segment  should  be  considered. 

Problems  arose  with  the  receipt  of  some  of  the  posttest  materials.  When 
the  program  administrator  moved  from  Fort  Knox  .because  of  a  change  in 
contractors,  some  of  the  cognitive  tests  ve re  lost;  these  tests  were 
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roadministe red  for  the  primary  analysis  group.  No  such  sr.ep  was  under  raker, 
for  the  ocher  groups  because  of  che  difficulcy  in  interpreting  daca  from  the 
r.ime  when  XL  was  implemented  sporadically  or  inconsistently. 

Finally,  each  teacher  and  some  of  the  students  were  aslted  for  4t heir 
opinions  about  the  IE  program. 

A  summary  of  the  data  collection  instruments,  the  data  sources,  and  the 
procedures  developed  is  presented  in  Appendix  A,  Table  A-l  . 
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RESULTS 


The  results  can  be  examined  according  to  three  categories — observation  of 
the  IE  teacher  training  process,  observation  of  the  ir.plenenr.at ion  of  IE,  and 
iaeasurenertt  of  student  gains. 

Observation  of  the  IE  Teacher  Training  Process 

The  results  of  the  Interviews  with  BSEP  teachers  can  be  categorized 
according  to  positive  outcomes  of  training  and  options  for  improving 
training.  In  the  first  category,  both  teachers'  opinions  about  the  materials 
and  training  and  their  plans  for  implementing  particular  exercises  are 
considered.  Comparison  of  the  teachers'  opinions  and  plans  with  outcomes 
intended  by  the  teacher  trainers  yielded  points  of  discrepancy,  which  can  be 
used  to  refine  future  training  procedures. 

In  the  second  category,  teachers'  direct  opinions  on  ways  to  improve  the 
trailing  and  the  applicability  of  IE  to  BSEP  are  presented.  The  opinions  of 
experienced  teachers  can  be  a  valuable  source  of  ideas  for  refinement  of 
methods. 

These  results  are  then  translated  into  a  set  of  re’comnenda t ions 
concerning  teacher  training  for  IE. 

Positive  outcomes  of  IE  teacher  training.  This  training  provided  the 
teachers  with  information  on  and  experience  in  new  teaching  materials  and  .  • 
methods.  The  teachers'  general  opinions  regarding  the  most  important  thing 
they  had  learned  are  presented  in  Table  A-2.  * 
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Two  of  the  teachers  made  three  positive  co.-rent s;  only  one  teacher  made 
none.  In  addition  to  learning  about  the  new  IE  instruments  and  methods  for 
using  them,  they  also  learned  about  new  ways  of  presenting  and  organizing  the 
instruction  and  about  new  concepts  to  be  used  in  teaching ...  One  teacher 
expressed  appreciation  for  having  two  trainers  with  very  different  teaching 
styles.  Other  teachers  mentioned  that  the  training  provided  some 
reinforcement  for  continuing  their  work. 

The  teachers  were  also  asked,  "Which  of  the  IE  instruments  do  you  expect 
the  most  success  with  in  BSEP?"  All  teachers  indicated  at  least  one 
instrument,  and  one  teacher  mentioned  five  of  the  instruments.  The  responses 
reflected  the  emphasis  that  we  observed  in  the  training.,  which  included 
severa,  ays  on  Organization  of  Dots.  In  addition,  the  teachers  identified 
instruments  that  were  interesting  and  challenging  for  adults,  provided  easy 
bridges  into  the  subject  matter,  and  emphasized  technical  skills  needed  in  the 
Army. 

In  an  effort  to  determine  plans  for  using  specific  IE  exercises,  each 
teacher  was  then  asked  to  select  a  single  page  from  a  single  instrument  to 
discuss.  The  instruments  selected  included  Organization  of  Dots,  Orientation 
in  Space  1,  Instructions,  and  Numerical  Progression.  In  tnaki ng  selections, 
the  teachers  tended  to  pick  a  favored  instrument.  Other  reactions  concerned 
difficulty,  relevance  to  the  world  today,  and  usefulness  in  basic  suoject. 

Only  one  teacher,  who  picked  the  instrument  Instructions,  indicated 
di s agre emenu  with  the  way  in  which  it  was  written. 

In  focusing  on  the  one  selected  page,  the  teachers  were  asked  how  r.he 
objectives  of  the  page  might  relate  to  benefits  in  Army  life.  The  responses 
to  this  question  are  presented  in  Table  A-3 .  Several  differ<nr  benefits  to 
the  soldiers  were  identified;  these  benefits  focused  on  cognitive  skills 


25 


useful  in  the  Artsy  ar.d  in  everyday  life.  U’hile  one  teacher  identified  three 
benefits,  three  of  the  nine  teachers  believed  either  that  the  cognitive  skills 
w?ere  not  applicable  to  Army  life  or  that  the  soldiers  would  not  apply  these 
skills  when  needed. 

A  final  potential  benefit  of  the  training  Involved  the  development  of  the 
teachers'  ability  to  recognize  students  having  difficulty  with  the 
instruments.  Thus,  they  were  asked  how  they  would  identify  such  students. 

The  responses  reflected  the  typical  indicators  used  by  teachers  in  most 
classroom  situations,  with  or  without  IE — for  example,  incorrect  answers  and 
erasures,  students'  inability  to  give  instructions  or  reasoning  in  their  own 
words,  speed  of  responses,  and  facial  expressions.  Only  one  indicator — 
precision  of  contributions  to  later  subject-matter  discussions — appeared 
directly  related  to  IE.  With  IE  material  there  may  be  other  important 
indicators,  such  as  students  who  fail  to  Tar id ge  or  to  apply  the  cognitive 
skills  in  nonclassroom  situations. 

Options  for  improvement  of  training.  The  teachers  were  questioned 
regarding  their  suggestions  concerning  the  IE  training.  The  two  questions  and 
the  teachers'  responses  ere  shown  in  Table  A-4 . 

The  most  frequently  mentioned  suggestions  concerned  the  scheduling  and 

* 

organization  of  the  training  sessions.  A  second  set  of  recommendations 
focused  on  adaptations  of  the  IE  materials  and  training  fot  the  Army,  tiere, 
the  most  frequently  mentioned  suggestion  concerned  the  problem  of  the  limited 
course  time  available.  A  third  set  of  recommendations  concerned  other  topics 
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related  to  the  IE  materials  and  training.  The  two  nost  frequently  mentioned 
items  were  the  observation  of  classroom  teaching  and  bridging  into  the  subject 
matter. 

Finally,  after  selecting  one  page  of  one  instrument,  the  teachers  were 
asked  about  the  adequacy  of  the  craining  and  about  their  expectations  of 
problems  on  this  page.  The  comments  appear  in  Table  A-5.  Problem  areas  that 
could  be  remedied  in  future  teacher  training  were  helping  teachers  with 
bridging,  providing  a  teacher's  g^i^e  or  summary  for  Instructions,  and  helping 
teachers  to  assist  students  in  working  through  the  problems. 


Be  commendations  for  IE  teacher  training.  The  following  recommendations 
are  based  on  the  initial  training  alone.  The  teacher  trainers  were  advised  by 
the  research  staff  to  attend  to  some  of  the  problems  during  the 
implementation;  therefore,  some  of  the  concerns  disappeared,  lieu  concerns 
arose,  however,  as  the  teachers  gained  greater  experience  with  the 
materials.  In  any  case,  if  other  Army  BSEP  teachers  or  teachers  in  other  Army 
training  programs  receive  IE  training,  the  trainers  should  carefully  consider 
the  various  suggestions  regarding  problem  areas  offered  by  the  demonstration 
teachers  as  presented  in  Tables  A-£  and  A-5.  In  particular,  further  efforts 
may  be  needed  in  adapting  the  instruments  for  BSE?--both  for  the  adult 
soldiers  and  for  the.  limited  tine  periods  available. 

With  regard  to  the  organization  of  the  training,  tne  trainer  should 
consider  reducing  the  tine  spent  on  Organiz;  r  ion  of  Dots  and  increasing  that 
spent  on  other  instruments,  reducing  time  spent  on  discussion  of  high  points 
and  low  points,  starting  and  ending  sessons  on  time,  and  including  definite 
break  periods.  While  the  scheduling  of  training  sessions  will  depend  upon  the 
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preferences  of  rhe  teachers  at  the  selected  sites,  during  vacation  breaks  or 
during  afternoons  when  teachers  are  nor.  needed  in  the  classrooms  are  most 
desirable. 

An  important  component  of  the  teacher  training  involves  classroom 
observations  and  critiques  of  the  BSEP  teachers  by  the  teacher  trainers. 

During  these  sessions,  the  trainers  should  assist  teachers  in  such  problen 
areas  as  bridging  to  the  subject  matter,  using  the  cognitive  map  with 
students,  assisting  them  in  working  through  the  problems,  identifying  and 
assisting  students  having  problems  and  particularly  in  bridging,  and  assisting 
students  in  applying  IE  skills  outside  the  classroom.  The  trainers  should 
also  include  instruction  and  discussion  time  with  the  entire  group  of  teachers 
on  the  topics  already  noted  and  also  on  identifying  the  need  for  Orientation 
in  Space  I,  identifying  the  concrete  benefits  to  the  soldiers  of  learning  IE, 
and  helping  the  soldiers  apply  these  skil'ls. 

Furthermore,  attention  must  be  focused  on  providing  a  serious  answer  to 
the  teachers'  questions  about  the  limited  time  available  in  BSEP  for  the  IE 
instruction.  The  basic  issue  of  concern  here  involves  the  amount  of  transfer 
to  soldiering  skills  that  can  be  expected  from  a  shortened  version. cf  the  IE 
program.  In  other  words,  which  of  the  following  will  produce  the  most 
t ransfe r--brief  coverage  of  most  or  all  of  the  instruments,  or  in  depth 
coverage  of  only  a  few  of  the  instruments?  '.Chile  time  constraints  may  be  less 
problematic  in  other  training  settings,  if  further  development  of  IE  for  3SE? 
is  undertaken,  attention  should  be  directed  to  this  issue.  __  . 

Finally,  the  trainers  must  carefully  considei  whether  or  not  they  should 
devote  effort  to  solving  other  problems--that  is,  providing  a  summary  or  guide 
for  the  Instructions  instrument,  providing  some  instruction  or  summary  (or  al.1 
of  the  instruments,  revising  and  adapting  the  materials  even  further  for  rhe 
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shorn  tine  period  available  in  ESC?,  revising  and  adapting  the  r.arerials  c-vc-n 

further  for  adults,  providing  the  teachers  with  a  method  for  deciding’  which 

students  need  IE  the  most,  and  including  other  trainers  who  have  used  IE  with 

adult  students.  . 

.  % 

The  decision  to  devote  effort  to  any  or  all  of  the  above  options  vi 1 1 
probably  depend  upon  cost-effectiveness. 

Observation  of  the  Implementation  of  IE 

Three  sets  of  measures  are  included — observations  of  classroom 
activities,  student  performance  on  IE  exercises,  and  interviews  with  teachers. 

Observations  of  classroom  activities.  The  IE  program  calls  for  intensive 
and  highly  structured  efforts  by  classroom  teachers.  Feuerstein  (1980)  notes 
that  the  materials  "are  disseminated  only  to  teachers  who  have  received 
training"  (p.  410).  The  proper  use  of  the  materials  is  essential  to  the 
success  of  the  program.  Therefore,  as  a  measure  of  the  effectiveness  of  the 
training  received  by  the  teachers  and  as  a  predictor  of  the  student  gains  to 
be  expected,  researchers  observed  classroom  instruction  in  each  .E  BSEP  cycle 
at  Fort  Knox.  (See  Appendix  E  for  a  copy  of  the  Classroom  Observation  Form.) 

One  IE  BSEP  class  was  observed  for  each  teacher  for  each  of  four  cycles 
during  the  thirty  to.  thirty-five  days  of  class  each  cycle.  Observations  of 
classroom  activities  focused  on  the  amount  and  distribution  of  time  for  IE 
activities,  the  mechanics  of  IE  activities,  and  the  occurrence  of  events 
related  to  IE-targeted  skills.  Class  sizes  ranged  from  eight  r.o  19  for 
classes  taught  by  Teams  1  and  2,  with  means  of  13  and  14  respectively.  In 
Team  3,  two  teachers  had  class  sizes  of  approximately  six,  while  the  third  had 
classes  of  about  twenty ' soldiers . 


29 


One  group,  which  was  exposed  to  the  nost  extensive  IE  treatment,  was 
designated  as  the  "primary  analysis  group;**  its  gein  scores  were  considered 
most  meaningful.  Initially,  the  students  in  these  classes  were  to  be  exposed 
to  IE  materials  during  the  1 6- week  period  from  January  through  April  1962. 
During  the  first  eight  weeks  they  were  taught  by  Team  1;  after  that  they  were 
taught  by  Teem  2.  As  pointed  out  earlier.  Team  3  teachers  stopped  teaching  ID  • 
after  December  1981  .  Early  in  the  implementation,  one  of  the  teachers  in  Team 
1  refused  to  teach  the  IE  pages  but  continued  to  discuss  bridges  from  IE  to 
Army  or  to  academic  subject  matter.  Later  in  the  implementation,  one  of  the 
teachers  in  Team  2  also  refused  to  teach  .IE.  At  the  end  only  four  of  the  nine 
teachers  were  using  the  IE  materials. 

As  shown  in  Table  A-6,  the  average  number  of  IE  pages  to  which  students 
were  exposed  in  an  instructional  day  by  teachers  in  Team  1  and  Team  2  was 
approximately  five.  For  teachers  in  Team’ 3.  who  dropped  out  of  the  IE 
treatment,  the  average  was  lower.  If  this  average  were  representative  of  the 
entire  BSE?  cycle,  all  pages  of  the  selected  instruments  would  have  been 
covered.  Teacher  comments,  however,  indicated  that  the  level  of  IE  activity 
observed  was  more  tyrical  of  a  total,  for  the  week  and  in  one  or  two  instances 
amounted  to  as  much  as  half  the  coverage  for  the  total  cycle.  Informal 
observations  of  teachers'  records  of  pages  covered  indicated  that,  if  measured 
in  terms  of  numbers  of  pages  handed  out,  Teams  1  and  2  adequately  implemented 
IE  during  the  'Jovenber-Decenber  cycle,  end  Team  1  also  did ’in  the  January  - 
February  cycle.  Therefore,  the  primary  analysis  student  group,  taught  cy  i.ear. 

1  during  January  and  February ,  was  exposed  :c  adequate  numbers  of  pages  in  the 
first-level  instruments  (Organization  of  Dots,  Orientation  in  Space  I,  ■ 
Comparisons,  anc  part  of  Analytic  Perception) ,  but  probably  not  in  the 
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second-level  instruments  (the  remainder  of  Analytic  Perception,  Illustrations, 
Instructions,  Numerical  Progression,  and  Orientation  in  Space  111). 

Exposure  in  terms  of  total  time  reveals  a  similar  picture,  as  shown  in 
Table  A- 7.  In  the  classes  of  Teams  1  and  2  observed  prior  .to  April^,  between 
one-quarter  and  one-half  of  the  entire  BSEP  instruction  time  was  based  on  IF. 
materials.  The  April  observations  of  Team  2  revealed  a  drastic  decline  in  IE 
use.  However,  as  pointed  out  earlier,  these  may  not  have  represented  typical 
days. 

The  number  of  minutes  per  page  implied  by  the  data  presented  in  Tables 
A-6  and  A-7  ranged  from  12  to  31.  Exceptions  were  for  Team  1  in  October,  46 
minutes  per  page;  Team  2  in  April,  four  minutes  per  page;  and  Team  3  in 
December,  eight  minutes  per  page.  The  number  of  minutes  per  page  is  an 
important  statistic  because  each  page  was  intended  by  Feuerstein  as  the  basis 
for  a  complete  lesson,  with  opportunity  for  group  discussion,  discovery  of 
strategies,  instruction  in  cognitive  concepts,  development  of  vocabulary, 
self-analysis  of  performance,  and  generalization  of  skills  to  external 
situations.  Thus,  with  the  exception  of  Team  1  in  October,  no  teaching  team 
spent  the  specified  amount  of  tine  per  page  on  the  average.  Although  there 
were  a  few  individual  instances  in  which  a  teacher  spent  over  45  minutes  on  a 
page,  these  were  rare.  The  teachers  expressed  substantial'  ala m  that 
allocation  of  the  specified  tine  to  IE  would  deprive  the  soldiers  of  the  A3VA3 
and  GED  preparation  which  they  expected. 

While  the  materials  distributed  and  demonstrated  by  the  teacher  trainers 
indicated  that  one  page  per  fifty  minute  lesson  was  appropriate,  the  initial 
schedule  prepared  by  these  trainers  recommended  that  the  BSEP  classes  cover  a 
total  of  192  pages  in  roughly  eighty  classrooo  hours--an  average  of  2.2  pages 
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per  hour.  As  will  be  discussed  in  a  later  section,  the  original  schedule  was 
perceived  as  unrealistic  and  was  modified  prior  to  the  Jenuary  cycle. 
Nevertheless,  the  teachers  felt  some  pressure  to -cover  as  many  pages  as 
possible  in  each  period  in  which  they  used  the  IE  instruments. 

According  to  the  training  received  by  the  teachers,  the  time  spent  on 

each  IE  page  should  be  divided  into  Introduction,  Independent  Work, 

Discussion,  and  Summary.  The  Introduction,  approximately  20?  of  the  lesson, 

sets  up  the  context  for  the  exercises;  the  Independent  Work,  approximately 

50?,  develops  student  independence  and  self-confidence;  the  Discussion, 

approximately  20?,  identifies  the  concepts  involved  in  the  exercises  and'  helps 

the  students  to  internalize  then;  and  the  Summary,  approximately  10?,  provides 

« 

a  vehicle  for  later  recall  of  the  skills  learned. 

According  to  the  figures  in  Table  A-8,  the  time  allocation  during  the  . 
October,  November,  and  December  observatidns  was  generally  balanced,  although 
only  about  one- third  as  much  time  was  spent  by  Team  1  teachers  on  Discussion 
and  Summary  as  is  considered  appropriate.  The  time  allocation  deteriorated  in 
the  classes  observed  in  February  and  April,  however,  when  most  of  the  time 
devoted  to  IE  was  spent  on  Individual  Work. 

Among  the  four  activity  categories.  Independent  Work  is  the  eesiest  for  a 
teacher  to  manage,  because  of  the  paper-and-pencil  exercises  provided  by 
Feuerstein.  Discussion  is  the  hardest,  because  the  teacher  must  subtly  guide 
the  topics  toward  discovery  of  cognitive  strategies  and  spontaneously  generete 
appropriate  "bridges"  between  the  IE  exercises  and  "real  world"  problem  ,  . 
solving.  Tnus,  the  imbalances  observed  ere  indicative  of  less  than  complete 
teacher  training  and  indoctrination. 

Tne  effectiveness  of  an  IE  program  also  depends  on  what  is  done  curing 
the  time  allocated  to  each  of  the  four  phases.  Particular  activities  were 
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suggested  in  training  for  each  phase  of  the  IE  lesson,  and  the  frequency  of 
each  of  these  activities  was  recorded. 

The  objectives  of  the  Introduction  to  each  lesson  are  to  define  tasks, 
problems,  and  objectives,  and  to  arouse  interest  and  motivation.  Through 
questioning,  the  teacher  assists  students  to  focus  on  r.he  problem  and  to 
discover  the  instructions.  This  questioning  and  discussion  provides  the 
background  for  and  establishes  the  purpose  of  the  lesson.  The  teacher's 
materials  recommended  that  about  ten  minutes  out  of  a  fifty  minute  class  be 
devoted  to  the  introduction.  Some  form  of  introduction  to -pages  was  given  in 
25  of  the  35  classes  observed.  The  teacher  trainers  recommended  half  a  dozen 
questions,  which  were  included  in  supplementary  materials  discussing 
preparation  of  the  class  lessons.  The  data  Indicated  that  the  teachers  used 
these  questions  only  infrequently.  Each  question  was  used  in  only  about  half 
of  the  introductions  observed,  except  for  error  checking,  which  was  rarely 
addressed . 

Time  for  Independent  Work  was  provided  in  25  of  the  35  classes 
observed.  The  data  indicate  that  the  teachers  nearly  always  observed 
students'  work  and  offered  individualized  assistance.  Instances  of 
reinforcing  successful  mastery  and  initiating  discussion  of  problems  with 
individual  students  or  several  students  together  occurred  less  frequently. 

The  Discussion  section  should  take  place  for  abou’c  ten  minutes  when  nost 
students  have  completed  their  individual  work.  The  students  should  explore 
alternative  strategies,  identify  the  most  appropriate  strategy,  analyze  ar.y 
difficulties,  review  r.he  vocabulary,  concepts,  and  operatibns  that  were  used, 
and  bridge  to  daily-life  experiences  and  to  academic  subjects.  While  the 

teacher  materials  . recommended  questions  for  the  teachers  to  ask  to  stimulate 
the  discussions,  those  that  did  occur  rarely  went  beyond  the  concrete  IE  page- 
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to  include  a  bridge  to  real-life  problem-solving.  As  a  result,  many  students 

as  well  as  teachers  referred  to  IE  in  terns  of  the  content  of  the  exercises — 

for  example,  "we  did  dots  today."  It  should  be  noted  that  one  of  the  three 

teachers  in  Team  1  taught  no  IE  pages,  but  she  did  devote  some  classroom  tine 

to  bridging  from  IE  to  Array  experiences  and  to  academic  subject  natter.  The 

Discussion-  period  was  also  to  include  some  review  of  vocabulary  items.  The 

average  was  approximately  one  word  per  class  period,  except  in  April  when 

there  were  none.  With  a  few  exceptions,  the  Discussion  periods  generally 

failed  to  meet  the  criterion  of  adequate  implementation. 

The  Summary  should  include  a  restatement  of  the  lesson's  objectives.  The 

ideal  IE  lesson  concludes  with  about  five  minutes  out  of  a  fifty  minute 
* 

period.  When  included,  the  Summary  was  of  reasonable  length,  approximately  IX 
of  the  total  IE  time.  However,  the  data  indicate  that  this  component  occurred 
in  only  7  of  the  35  classes  observed. 

In  addition  to  recording  information  about  time  and  frequency  of  lesson 
activities  occurring  in  the  IE  classes,  instances  of  or  emphasis  given  to 
certain  cognitive  skills  were  also  observed.  Each  lesson  is  more  likely  to 
teach  cognitive  skills  if  the  teacher  emphasizes  then.  Otherwise ,  the 
students'  only  exposure  to  the  skills  is  in  using  them  on  the  exercises. 
Ideally,  each  class  should  cover  each  skill.  Skills  included  in  the  classes 
observed  are  shown  in  Table  A-9. 

Although  teachers  had  indicated  concern  about  how  to  -"bridge"  between  IE 

and  real-world  proolem  solving,  they  did  include  this  skill  in  their  IE  ^  . 

presentations  in  70'i  of  the  classes..  They  also  discussed  the  concepts  of 

strategy  and  planning  and  emphasized  the  vocabulary  of  pr oblemrsolving  and  . 

■  • 

cognition  in  more  than  half  the  classes,  and  they  frequently  pointed  our,  the. 
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importance  of  careful,  analytic  perception  and  self-checking  for  accuracy. 

They  tended  to  cover  the  other  cognitive  skills  only  sporadically,  or  only  in 
lessons  dealing  specifically  with  those  skills.  The  teacher  vho  used  no  IS 
pages  per  se,  but  vho  taught  vith  two  team  members  vho  did,  .ves  observed  to 
cover  the  cognitive  skills  listed  at  least  as  well  as  any  other  teacher. 

The  cognitive  skills  that  Feuerstein  focused  on  are  an  important 
contribution  to  remedial  education,  and  a  major  outcome  of  IE  teacher  training 
is  to  familiarise  teachers  vith  these  skills.  The  overall  average  of  the 
percentage  of  classes  in  vhich  each  skill  was  emphasized  decreased  from  45?  in 
October  through  February  to  17?  in  April. 

Finally,  the  general  level  of  student  classroom  interest  in  IS  was  rated 

i 

on  a  scale  of  from  1  to  5 — definitely  uninterested,  somewhat  uninterested, 
mildly  interested,  interested,  very  interested.  The  distributions  of 
classroom  ratings  are  shown  in  Table  A-10.  Evidence  that  students  were 
"somewhat  uninterested"  included  making  fun  of  the  materials  ant’  good-natured 
complaints  about  wasting  time;  evidence  that  students  were  "definitely 
uninterested"  included  open  disregard  for  the  exercises  by  some  students,  vith 
serious,  strong  negative  comments.  Evidence  that  students  were  "very 
interested"  was  the  active  discussion  end  rich  flow  c:  ideas  about  cognitive- 
skills,  which  the  IE  teache r- t rainer  demonstrated  as  the  model  of  an  ideal  IE 
class. 

There  vas  substantial  variation  in  implementation  between  teachers. 
However,  for  rain-line  BSE?  students  taught  by  Teams  1  and  2,  all  were  exposed 
to  a  variety  of  levels  of  implementation.  In  terns  of  the -overall  mechanics 
and  content  of  the  IE  implementation,  there  vere  two  general  findings.  First, 
the  IE  materials  were  being  used  in  clesses.  However,  the  classes  observed 

nay  not  nave  been  representative  of  the  entire  ESE?  cycle,  ar.c,  in  any  case, 
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usage  decreased  greatly  during  the  final  eight  week  period  Second,  although 
the  Introduction  and  Independent  Work  phases  of  lessons  were  implemented  well 
and  "bridging,"  strategies,  and  problem-solving  .vocabulary  were  mentioned, 
with  few  exceptions  the  Discussion  and  Summary  phases  were  generally  too  brief 
and  superficial  to  be  effective. 

Thus,  two  reasons  for  expecting  negative  results  from  student  gain 
analyses  that  would  noc  necessarily  generalize  to  other  demonstrations  were 
identified.  First,  the  primary  analysis  group  was  exposed  to  IE  during  the 
period  of  declining  implementation,  January  to  April.  Second,  if  the 
Discussion  and  Summary  phases  of  the  lesson  are  essential  for  student  gains, 
then  the  effectiveness  of  IE  may  have  been  substantially  weakened. 


Student  performance  on  IE  exercises.  Performance  on  IE  materials 
completed  in  class  provides  a  measure  of  'the  student  performance  level  as  well 
as  an  indication  of  the  effectiveness  of  training.  If  all  or  most  students 
complete  certain  pages  without  error,  then  the  students  nay  have  already 
acquired  the  cognitive  skills  needed  for  the  exercises.  .Assuming  that 
cognitive  deficiencies  exist  among  these  students,  then  the  performance  level, 
particularly  on  early  pages  in  an  instrument,  should  be  fairly  low.  If  the  . 
training  is  effective,  and  the  exercises  do  not  increase  dramatically  in 
difficulty,  then  student  performance  ought  to  improve  with  later  pages  in  the 
same  injt rument . 

The  pages  analyzed  were  selected  because  most  of  the  students  had  worked 
on  them.  During  the  January-Februar.y  cycle,  pages  from  Organization  of  Dots, 
Orientation  in  Space,  and  Comparisons  were  received  fr cm  students  in  classes 
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taught  by  Team  1.  During  the  liarch-April  cycles,  only  pages  fron  Organization 
of  Dots  were  received.  Therefore,  only  two  of  the  ten  pages  examined 'could  be 
compared  for  the  Wo  tine  cycles  and  student  groups. 

j 

The  results  of  students'  work  on  the  selected  pages' is. presented  in  Table 
A-l 1 .  It  should  be  remembered  that  the  IE  materials — and,  hopefully,  the 
classroom  Discusslon--stress  the  importance  of  planning  and  precision  in 
attacking  and  solving  problems.  Control  over  impulsive  responding  is  expected 
to  lead  to  elimination  of  the  need  to  erase  and  revise  responses.  Thus, 
examination  of  completed  IE  materials  considered  both  errors  and  erasures  as 
indications  that  students  had  experienced  some  difficulty  with  the  materials. 

The  data  from  Organization  of  Dots  for  the  JanuaryyFebruary  cycle 
indicated  that  these  IE  problems  were  difficult  for  the  soldiers;  only  one 
person  in  the  class  made  no  errors  or  erasures.  There  appeared  to  be  some 
improvement  over  time — for  example,  the  percentage  without  errors  improved 
from  72  to  462.  This  conclusion  is  very  tentative,  however,  because  the  pages 
are  neither  equated  for  difficulty  not  uniformly  increasing  in  difficulty. 

Data  from  the  March-April  cycle  also  indicated  that  the  problems  presented  in 
Organization  of  Dots  posed  some  difficulties. 

The  problems  in  Orientation  in  Space  I  appeared  to  be  somewhat  easier  for 
the  soldiers,  although  nearly  half  of  the  class  made  some  error  or  erasure.  A 
somewhat  similar  pattern  emerged  from  the  data  on  Or  ie'r.tat  ion  in  Space  with  an 
improvement  in  performance  from  the  earlier  to  the  later  page — 562  had  no 
errors  on  page  six,  and  902  had  no  errors  on  page  13.  The  deterioration  in 
performance  on  page  12,  with  a  large  number  of  errors  and  erasures,  may  have 
been  due  to  a  format  change — starting  with  page  12,  the  problems,  become 
abstract,  symbolic,  representations,  as  opposed  to  drawings  of-  individuals . 
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The  deterioration  in  performance  on  t'r.e  pages  from  Comparisons  appeared  to  be 
related  to  the  increased  complexity  of  the  problems  on  the  later  page--4 4$  had 
no  errors  on  page  three,  but  only  12*  had  no  errors  on  page  nine. 

This  analysis  of  student  performance  on  the  IE  exercises  thus  revealed 
that  the  exercises  were  not  easy  for  the  soldiers  and  that  the/  experienced 
some  difficulties,  but  it  also  provided  tentative  evidence  of  improvement  in 
performance. 

Interviews  with  teachers.  The  teachers  were  the  essential  mediators  in 
this  IE  implementation,  and  they  had  very ‘strong  ideas  about  the 
implementation  and  the  needs  of  teacher  training.  They  also  had  firsthand 
estimates  of  student  gains  in  cognitive  skills.  Researchers  therefore 
conducted  interviews  following  the  classroom  observations.  The  answers  to  ■ 
three  questions  suggest  changes  that  might  be  mode,  either  in  the  teacher 
training  or  in  the  IE  materials  for  future  implementations  with  similar 
groups.  The  answers  to  a  fourth  question  provide  some  non-test  data  to 
supplement  tests  of  student  gains. 

Teachers'  positive  open-enced  comments  about  the  program  are  shown  in 
Table  A-12.  The  comments  were  grouped  according  to  effects  on  students, 
effects  on  classroom  teaching,  er.c  training  end  raterials.  Thirty-one 
positive  comment's  were  made  in  54  interviews.  !-ics t  frequently  mentioned  were 
that  IE  generated  discussion  and  interest,  IE  concepts  and ' theory  such  as 
teaching  strategies  and  logical  reasoning  are  good,  and  students  likcc  IS.  .  . 
There  was  no  spontaneous  consensus,  however,  on  any  single  positive 
contribution  of  IE.  ... 
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Negative  open-ended  comments  are  shown  in  Table  A-13.  Because  they 
suggest  directions  for  improving  the  IE  implementation,  negative  comnents  can 
be  more  helpful  than  positive  comments.  The  comments  were  ground  according 
to  student  reactions,  effects  on  students,  teaching  and ‘classroom  problems, 
and  training  and  materials.  There  were  44  negative  comments  in  34 
interviews.  Only  two  contents  appeared  frequently — students  don't  like  IE, 
don't  want  to  be  "bothered"  with  it,  and  refuse  to  do  it;  and  lack  of  tine  is 
a  problem. 

Student  dislike  of  IE  appeared  to  be  related  to  immediate  concern  with 
raising  GT  and  GED  scores,  the  perceived  childish  look  of  the  instruments,  and 
the  repetition  included  in  certain  instruments.  The  comment  concerning  lack 
of  time  is  a  function  of  two  specific  characteristics  of  this  program 
implementation.  IE,  originally  designed  for  a  two-year  period,  was  condensed 
into  one  or  two  six-or  eight-week  cycles,  and,  since  the  bottom  line  measure 
of  the  teachers'  success  was  the  level  of  student  gains  on  the  GT  and  GED 
tests,  they  felt  that  their  primary  responsibility  was  to  concentrate  on 
subject  matter  instruction.  This  problem,  was  exacerbated  by  r.he  difficulties 
that  teachers  encountered  in  bridging  between  IE  and  their  regular  subject 
matter. 


Teachers'  recommendations  for  modifications  in  the  IE  program  are  shown 
in  Table  A-14.  Four.ty-four  recommendations  were  made  in  34  interviews,  kith 
regard  to  training,  the  teachers  expressed  a  need  for  more  classroom 
observations  by  the  teacher  trainers  and  more  feedback  from  them.  The 
teacher's  manual  needed  more  practical  ideas,  including  ways  to  bridge  to 
subject  matter  and  to  the  Army.  In  addition,  it  needed  better  editing  to 
improve  the  organization  and  rw  correct  the  errors.  Regarding  instruments,  a 
frequent  comment  was  that  they  should  have  fewer  pages.  This  was  probably 
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related  to  the  teachers'  concerns  about  the  lack  of  tir.e  and  the  students' 
reactions  to  the  repetition.  Teachers  also  recommended  that  the  instruments 
be  modified  for  use  by  adults,  particularly  Orientation  in  Space  1  and 
Illustrations.  And  regarding  implementation,  teachers  felt  that  a  longer 
period  of  time  was  needed.  They  indicated  that,  it  would  be  better  to  present 
IE  in  basic  training,  BSEP  1,  or  junior  high  school,  where  the  focus  is  on 
prerequisite  skills  ana  more  time  might  be  devoted  to  IE. 

However,  regardless  of  their  misgivings  about  the  IE  adapation  used,  the 
teachers  did  report  observing  positive  trends  i_n  the  development  of  cognitive 
skills  by  some  of  their  students.  Specific  changes  in  student  behavior- 
observed  by  teachers  in  Teams  1  and  2  are  presented  in  Table  A-15.  Because 
the  October  and  November  interviews  were  conducted  too  early  in  the  BSEP 
cycle — and  in  the  IE  implementation  within  that  cycle--for  gains  to  have  been 
reliably  observed,  data  were  collected  in  only  17  interviews  beginning  in 
December.  The  roost  frequently  mentioned  changes  were  increased  participation 
in  oral  discussion  (n=*14),  improved  use  of  vocabulary  and  concepts  taught  in 
class  (n=14),  and  improved  ability  to  follow  directions  (n<*3).  Of  those 
behavioral  changes  covered  in  the  interview  fort  the  change  noted  least 
frequently  was  increased  relevance  and  completeness  of  answers. 

The  differences  in  frequency  regarding  behavioral  'changes  should  be 
interpreted  with  caution,  however;  they  nay  be  a  function  of  teachers'  ability 
to  report  behaviors  according  to  the  researchers'  categories  rather  than  a 
function  of  the  accual  occurrence  of  the  behaviors.  Furthermore,  there  is_  . 
uncertainty  concerning  cause-effect  relations  between  IE  implementation  and 
the  observation  of  gains  on  these  skills.  To  provide  useful  data  and  to  guard 
against  superficial  positive  responses  to  questions  about  student  gains,,  the  - 
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teachers  were  asked  to  identify  one  or  more  specific  students  eiose  gains  were 
notable  whenever  gains  in  the  class  were  reported. 

In  general,  it  appeared  that  most  of  the  teachers  tool;  the  IE 
implementation  seriously  and  hoped  that  it  would  be  helpfuL.  Theirt 
identification  of  difficulties  and  recommendations  for  change  should  be 
carefully  considered  in  any  future  adaptation  of  IE  for  use  with  an  adult 
population  in  a  limited  tine  period. 


Measurement  of  Student  Gains 

Both  standard  and  newly  developed  paper  and  pencil  tests  were 
adiministered  to  measure  student  gains.  There  was  no  control  group  in  the 
design  of  this  IE  demonstration,  although  the  data  were  compared  with  data 
from  a  BSEP  cycle  a  year  earlier.  This  comparison,  however,  proved 
difficult.  The  criterion  test  used  in  the  1980  cycle  was  the  ABLE  rather  than 
the  TABE  and,  although  the  pre-post  GT  gains  were  similar  for  both  cycles, 
peculiarities  were  found  in  the  pre-GT  scores  as  described  below.  The  general 
conclusion  reached  was  that  the  gains  for  the  two  cohorts  were  about  the  same 
and  that  they  were  both  significant. 

The  evaluation  of  impact  is  limited  to  the  three  cycles  of  soldiers  in 
the  14-  or  16-week  BSEP  cycles  starting  in  November  1981,  January  1982,  and 
March  1982.  Except  Jor  students  taught  by  Team  1  in  the  January  cycle,  all 
before-after  test  comparisons  are  for  the  first  six  or  eight  weeks  of  ESE? 
training.  Therefore,  the  primary  analysis  group  is  the  set  of  students  who 
started  in  January  with  Team  1  and  continued  through  April;  a  total  of  16 
weeks. 

It  is  possible  to  reach  some  conclusions  about  the  contribution  of  IE  to 
learning,  even  with  the  short  time  spans  for  the  cycles.  Standard  ASVA5  GT 
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scores  and  TAliE  scores  wore  obtained  by  the  BSE?  staff,  and  scores  were  al 
obtained  on  two  newly  developed  cognitive  tests.  The  test  made  up  of  page 
extracted  from  IE  materials  is  included  in  Appendix  C,  and  the  test  of 
Cognitive  Skills  which  IE  is  intended  to  foster  is  included  in  Appendix  D. 
These  tests  include  the  following  subtests: 
o  IE  Test 

o  Comparisons 
o  Illustrations 
o  Instructions 
o  Orientation  in  Space  111 
o  Analytic  Perception 
o  Orientation  in  Space  1 
o  Numerical  Progression 
o  Categorization 
o  Organization  of  Dots 

o  Cognitive  Skills  Test 

o  Map  Reading 

o  Identification  of  Problem  Dimensions 
o  Ordering 

o  Use  of  Common  Objects 
o  Cognitive  Vocabulary 
o  Generation  of  Problem  Solutions 


o  TABE 


o  Reading  Vocabulary 

o  Reading  Comprehension  . 

o  Reading  Toral 
o  Mach  Computation 
o  Hath  Concepts  and  Problems 
o  Math  Total 

o  Language  Mechanics  and  Expression 
c  Spelling. 

It  was  hypothesized  that,  if  the  IE  lessons  were  having  any  effect,  gains 
would  be  apparent  on  the  IE  Test.  If  these  gains  generalized  to  the  cognitive 
skill  domains,  then  scores  on  the  two  tests  should  be  correlated,  and  there 
should  be  gains  on  the  Cognitive  Skills  Test.  If  either  IE  Test  gains  or 
Cognitive  Skills  Test  gains  transfered  to  TABE  and  CT  scores,  then  scores  on 
TABE  and  GT  should  be  correlated  with  scores  on  the  IE  Test  or  the  Cognitive 
Skills  Test,  and  nnere  should  be  gains  on  TABE  and  GT. 

Finding  gains  cn  TABE  and  GT  that  were  unrelated  to  IE  or  Cognitive 
Skills  is  possible,  of  course,  either  because  gains  in  the'  IE  or  Cognitive 
Skills  were  not  needed  for  TABE  and  GT  gains  or  because  the  IE  Test  and  the 
Cognitive  Skills  Test,  which  were  newly  developed  and  quite  short,  failed  to 
detect  the  IE  or  Cognitive  Skills  gains. 

The  correlations  among  the  three  measures  used  to  determine  gains  can  be 
examined  to  determine  the  degree  of  correspondence.  While  these. data,  as 
shown  in  Table  A-L6,  can  suggest  links  between  IE  gains  and  other  test  score 
gains,  they  cannot  be  translated  into  causal  relationships.  Correlations 
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betv.een  Ordering  and  both  Categorisations  and  Orientation  in  Space  III  were 
•significant  for  both  the  pretest  and  the  posttest.  The  only  other  consistent 
correlations  between  the  subtests  were  between  Analytic  Perception  end  Kap 
Reading  and,  negati  ely  between  Orientation  in  Space  III  and  Uses  of  Common 
Objects.  It  should  be  noted  that  the  large  g2ins  on  Organization  of  Dots 
exercises  did  not  generalize  to  the  Cognitive  Skills  subtests. 

In  interpreting  these  analyses,  it  i®  useful  to  know  the  reliabilities  of 
the  teats  While  separate  reliability  data  were  not  collected,  pretest- 
posttest  correlations  were  calculated.  These  correlations,  ahown  in  Table 
A-17,  are  probably  slight  underestimates  -df  the  reliabilities  in  most 
cases-  -;*  20? .  The  pretest-posttest  correlations  ranged  from  .20  to  .62  for 
the  IE  Test  and  from  .34  to. 79  for  the  Cognitive  Skills  Test.  For  a 
definitive  study,  it  would  have  been  preferable  to  have  had  a  more  extensive 
batteiy  than  this  one-hour  coverage  of  15  subtests.  However,  these 
correlations  are  generally  comparable  to  those  for  the  TABE,  which  ranged  from 
•51  to  .76. 

The  pretest- posttest  correlation  for  the  CT  composite  of  the  ASVAB  ves 

surprisingly  low--. 32.  This  led  to  further  examination  of  the  CT  tests,  as 

shown  in  Table  A-18.  While  there  were  reasoneble  correlations  between  the  CT. 

and  the  TABE  scores  for  the  posttest--fron  .26  to.79--the  pretest  CT  scores 

were  virtually  uncorrelated  with  the  TABS  scores,  with  correietior.s  ranging 

from  -.05  to  .28.  In  fact,  the  pretest  TABE  scores  are  much  more  closely 

correlated  with  post-GT  scores  than  with  pre-GT  scores.  Although  explanation 

for  this  finding  is  beyond  the  scope  of  this  study,  one  possibility  is  that 

the  value  of  GT  scores  obtained  by  these  soldiers  on  entry  to  the  service  met 

•  » 

be  questionable. 
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BSEP  students  achieved  gains  on  ul  1  of  the  TAdE  sub  tests- -in  effect,  so: 
or  eight  weeks  of  BSEP  was  equivalvent  to  nearly  a  year  of  schooling.  The 
largest  gains  were  in  Math  Computation  and  Language  Mechanics  and 
Expression.  These  gains  were  generally  much  more  substantial  chan  ,could  be 
accounted  for  by  gains  on  either  the  IE  Test  or  the  Cognitive  Skills  Test. 

The  significant  and  consistent  correlations  are  shown  in  Table  A-19  for  the  I 
Test  and  Table  A-20  for  the  Cognitive  Skills  Test.  The  only  relation  to 
Reading  scores  was  the  correlation  between  Use  of  Common  Objects  and  Reading 
Total;  the  only  scores  significantly  correlated  with  Language  Mechanics  and 
Expression  were  Orientation  in  Space  III  and  Map  Reading;  and  no  variables 
were  significantly  correlated  with  Spelling.  Math  Concepts  and  Problems  was 
significantly  correlated  with  only  Numerical  Progression. 

Generally,  there  was  a  significant  correlation  between  the  total  TA3E 
battery  score  and  the  Cognitive  Skills  Test  (r«.37).  There  was  also  a 
significant  posttest  correlation  between  the  total  TABE  battery  score  and  the 
IE  Test  (r=.44),  which  did  not  occur  for  the  pretest  (r*.17).  This  is 
consonant  with  the  hypothesis  that  the  IE  Test  scores  were  more  meaningful 
after  instruction  than  before,  which  might  be  due  to  the  paucity  of 
instructions  given  with  the  exercises.  The  correlation  of  the  IE  Test  and 
Cognitive  Skills  Test  scores  with  GT  could  only  be  measured  at  the  tine  of 
posttest,  as  noted  above.  There  were  significant  correlations  with 
Comparisons,  Orientation  in  Space  III,  and  Categor izations ,  and  with  Ordering 
and  Use  of  Common  Objects. 

Finally,  the  primary  analysis  group  was  followed  through  a  16-week,  two- 
cycle  BSEP  program;  the  results  are  summarized  in  Table  A-21.  The  results 
indicated  that,  although  gains  occurred  during  the  first  eigh't  weeks,  no 
additional  gains  occurred  as  a  result  of  the  extra  eight  weeks  of 
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instruction*  One  ^xpld  nsrion  is  th.it  a  ceiling  h.ui  been  reached  on  the  amount 
of  knowledge  that  could  be  assimilated  by  the  soldiers  from  continuous  BSEP 
attendance.  An  alternative  explanation  is  that  -the  teachers  may  not  have  been 
as  attentive  during  what  was  the  final  period  of  their  unrenewed  contract. 

This  alternative  explanation  is  not  substantiated,  however,  both  because  the 
teachers  utre  observed  to  be  continuing  their  instruction  responsibly,  and 
because  TABE  gains  continued  to  be  shown  for  other  soldiers  during  this 
period . 

In  summary ,  the  gains  that  occurred  on  the.  TABE  were  not  clearly  related 
to  gains  on  the  Cognitive  Skills  Test,  nor  were  the  substantial  gains  oA  the 
IE  Organization  of  Dots  subtest  correlated  with  other  gains.  There  were  a  few 
suggestive  correlations  but,  in  general,  the  objectives  as  represented  by 
short  range  gains  on  the  TABE  appear  to  be  unrelated  to  short  range  Cognitive 
Skills  Test  gains.  It  may  be  necessary  t'o  make  a  choice  between  these  two 
objectives  in  planning  for  future  implerae ntations  of  Feuerstein's  Instrumental 
Enrichment  in  BSEP.  In  any  case,  the  IE  program  was  designed  to  produce  long 
term-~not  short  cerm — gains,  and  a  thorough  evaluation  will  require  the  follow 
up  of  both  the  participating  soldiers  and  a  control  group  for  at  least  a  year. 
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DISCUS  SION 


The  process  and  results  of  an  adaptation  of  Feuerstein's  IE  program  for 
use  in  BSE?  II  was  examined  from  August  1981  to  April  1$82,-  In  addition  to 
determining  whether  IE  training  leads  to  gains  in  cognitive  functions,  the 
links  between  IE  program  inputs  and  various  test  score  gains  were  analyzed  and 
the  needs  for  improvement  in  future  adaptations  of  IE  for  Army  use  were 
identified.  Special  emphasis  was  given  to  evaluation  of  the  teacher  training 
and  implementation  process.  The  evaluation  was  based  on  a  model  of  the 
demonstration,  Including  the  categories  of  factors  that  might  affect  the 
improvement  of  soldiers'  performance — teacher  preparation,  classroom  time  and 
other  resources,  adequacy  of  the  IE  materials,  and  teacher  and  student 
motivation.  In  the  context  of  the  limited  time  of  the  present  demonstration, 
only  a  partial  investigation  of  the  model  was  possible. 

Teacher  Preparation 

Several  indicators  pointed  to  the  fact  that  training  for  teaching  IE  was 
inadequate.  For  example,  at  the  end  of  training,  only  six  of  the  nine 
teachers  were  able  to  identify  in  an  IE  exercise  the  cognitive  functions 
important  for  soldiers.  The  teachers  themselves  acknowledged  inadequacies  in 
the  training  by  suggesting  that  the  training  needed  nore  feedback  on  attempts 
to  use  IE  in  classroom  teaching  or  more  demonstrations  of  teaching, 
introduction  of  better  methods  for  bridging  between  IE  exercises  and  academic 
subject  matter,  and  better  organization  of  the  training.  Later  in  the 
implementation,  these  inadequacies  in  teacher  training  were  evident  in  the 
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actual  teachicg--liroi  ted  time  was  devoted  to  the  Introduction  and  the 
Discussion  of  IE  exercises,  e  Summary  was  lacking  at  the  end  of  the  IE 
lessons,  and  there  was  limited  inclusion  of  cognitive  functions  in  class 
lessons. 

Classroom  Time  and  Other  Resources 

Because  of  the  restrictions  of  the  original  BSEP  training  cycle,  the  time 

available  for  full  implementation  of  the  IE  program  was  inadequate.  The 

original  training  cycle  included  17.5  class  hours  a  week  for  12  weeks  for  a 

total  of  210  clasa  hours  per  cycle,  and,  -Assuming  one  hour  per  page  presented 

in  class,  the  original  schedule  for  the  IE  implementation  required  176  class 

* 

hours.  Given  the  additional  need  to  cover  language,  reading,  and  math  skills 
in  BSEP,  these  schedules  were  incompatible.  During  the  demonstration,  the  • 
BSEP  cycles  were  increased  to  14  weeks  aacl  then  to  1b  weeks,  finally  totaling 
280  hours  of  classroom  instruction.  This  would  have  been  adequate  if  there 
had  not  also  been  the  concurrent  goal  of  improving  language,  reading,  and  math 
scores.  To  deal  with  the  competing  objectives,  teachers  reduced  the  number  of 
IE  instruments,  reduced  the  number  of  pages  in  each  II  instrument,  and  reduced 
the  time  spent  on  each  IE  page.  Each  of  these  chenges  contributed  to  a 
generally  inadequate  IE  program  implementation. 

Adequacy  of  IE  Materials 

According  to  the  teachers,  the  IE  materials  required  major  .  • 

improvements.  The  teacher's  manual  needed  more  practical  ideas,  better 
editing  and  organization,,  and  better  guides  to  brio ging  . between  IE  exercises' 
and  academic  subject  matter  anti  Arr.v  tasks. 
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The  IE  instruments,  originally  designed  for  adolescents,  needed  to  be 
revised  for  use  with  an  adult  population.  For  use  in  the  limited  time" 
available  to  the  BSE?  program,  a  narrower  focus  on  cognitive  skills  is  needed 

j 

m  • 

with  selections  from  among  the  instruments  and  from  among  pages  within  the 
ins  trunents. 

Teacher  and  Student  Motivation 

Teachers  were  in  .general  agreement  with  the  goals  of  the  IE  program, 

although  in  the  limited  time  available  they  felt  a  conflict'  with  the  needs  of 

the  soldiers  for  instruction  in  reading,  language  arts,  computation,  and 

science.  Luring  the  final  stages  of  the  demonstration  the  program  was 

% 

disrupted  by  the  award  of  the  next  BSE?  teaching  contract  to  a  new  firm,  thus 
bringing  the  teachers'  jobs  into  jeopardy. 

The  students  appeared  to  be  mildly  interested  in  the  IE  exercises.  Their 
main  motivation  and  reason  for  participating  in  BSEP  was  to  improve  their  GT 
scores  or  to  acquire  General  Educational  Development  (GED).  Vhen  teachers 
conveyed  a  sense  that  the  IE  materials  would  help  them  in  their  pursuits, 
students  responded  positively  to  IE.  However,  only  five  of  the  15  Cognitive 
Skills  subtests  and  IE  subtests  actually  correlated  with  GT  scores  at  the  time 


of  the  posttest: 

IE  -Categorization  r=.73 
IE  Orientation  in  Space  III  t* .o2 
IS  Comparisons  r*.ih 
Cognitive  Skills  Use  of  Common  Objects  *  r,!.53 
Cognitive  Skills  Ordering  r».^9. 


Thus,  soldiers  who  felt  that  the  IS  work  would  not  help  them  *in  the  snort  term 
in  their  pursuit  of  higher  GT  scores  nay  have  been  justified  in  their 
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belief.  This  resulr  cannot  generalize  to  longer  ten:,  effects,  however, 
without  a  longer  terra  demonstration. 


Student  Gains  in  Cognitive  Functions 

Gains  in  cognitive  functions  were  assessed  using  a  test  designed  by  the 
research  staff,  together  with  selected  sections  of  the  IE  instruments.  Only 
five  of  the  15  tested  skills  showed  significant  gains  from  the  pretest  to  the 
post test : 


IE 

Organization  of 

Dots 

.  t*5 .46  , 

df=34 ,  p< .002 

IE 

Categorization 

t*3.02 , 

df-34,  p< .02 

IE 

Orientation  in 

Space  I 

r=2 . 72  , 

df  =  34,  p<.05 

IE 

Orientation  in 

Space  III 

t=2 . 52  , 

df =3 4 ,  p< .05 

Cognitive  Skills  Ordering  t**2.20,  df-36,  p<.05.  •  , 

Some  generalization  of  IE  gains  is  indicated  by  the  fact  that  posttest  scores 
on  Ordering  were  correlated  with  both  Categorization  (r=.39)  and  Orientation 
in  Space  III  (r*.35).  On  the  other  hand,  the  largest  gains  appeared  in 
Organization  of  Dots,  but  tnese  gains  did  not  generalize  to  any  of  the 
Cognitive  Skills  subtests  or  to  the  .course  criterion  test,  the  TABE. 


Student  Gains  in  Skills  Tested 

Significant  gains  similar  to  those  obtained  in  a  prior  BS1?  cycle  not 
employing  IE  occurred  on  all  six  TABE  subtests — reading  vocabulary,  reading 
comprehension,  math  computation,  math  concepts  and  problems,  language  .  • 

mechanics  and  expression,  and  spelling.  The  students  showed  gains  j! 
approximately  one  year  of  schooling  as  a  resulr.  of  six  or  eight  weeks  of 
BS EP .  Because  the  variables  were  not  highly  correlated,  these  gains,  which  are 


similar  to  gains  at  other  BSEP  installations,  were  more  substantial  than  could 
be  accounted  for  by  gains  on  the  IE  and  Cognitive  Skills  Tests. 


SUMMARY 


The  main  finding  of  the  evaluation  is  that  the  demonstration  of  the 

adapted  Feuerstein  IE  program  undertaken  as  part  of  the  Fort  Knox  BSEP  II 

program  was  an  inadequate  implementation.  On  the  basis  of  this  tryout,  it  is 

impossible  to  reach  any  valid  conclusion  about  the  potential  value  of  IE  in 

the  Array.  A  critical  factor  affecting  the  implementation  was  termination  of 

the  ceachers'  contract  in  the  middle  of  the  demonstration.  Other  factors  also 

led  to  a  poor  implen>entation--insuf f icient  class  time  was  allocated  for 

implementing  a  two-year  program  within  the  context  of  the  six  or  eight  week 

BSEP  cycle;  the  IE  materials  were  not  appropriately  adapted  for  Amy  use  in 
* 

BSEP,  as  indicated  by  the  disparaging  comments  of  both  teachers  and  students; 
teachers  were  inadequately  prepared,  as  revealed  in  failures  to  use  specified 
techniques;  and,  because  of  problems  with  classroom  time  and  with  teacher  and 
student  motivation,  students  failed  to  work  through  all  of  the  problems. 

There  were  a  few  significant  gains  in  student  performance  as  a  result 
of  the  IE  implementation.  Significant  pretest-posttest  gains  were  observed 
in  selected  sections  of  four  IE  instruments — Organization  of  Dots,  Categori¬ 
zation,  Orientation  in  Space  I,  and  Orientation  in  Space  III — and  in  one 
component  of  the  Cognitive  Skills  Test — Ordering.  The  posttest  scores  on 
Ordering  were  also  correlated  with  both  Categorization  and  Orientation  in 
Space  III.  Furthermore,  posttest  GT  scores  were  correlated  with  IE  subtests 
in  Categorization,  Orientation  in  Space  III,  and  Comparisons,  and  with  the 
Cognitive  Skills  Test  subtests  in  Use  of  Common  Objects  and  Ordering.  Al¬ 
though  significant  gains  appeared  on  all  subtests  of  the  TABE,  these  gains 
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were  similar  to  those  in  previous  BSEP  cycles  that  did  not  employ  IE,  and 
they  were  not  correlated  with  gains  on  either  the  IE  Test  or  the  Cognitive 
Skills  Test. 
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R  ECOMJEKDAT  ION’S 

Given  the  problems  experienced  in  attempting  to  demonstrate  IE  within  the 
context  of  BSEP  II — short  class  cycles,  contract-  teachers  with  minimal 
training  in  the  subject  matter,  contract  teachers  with  a  probability  of  being 
replaced  by  the  lowest  contract  bidder--a  demonstration  of  IE  in  the  Army  nay 
be  best  undertaken  within  another  training  program.  If  IE  were  to  be 
implemented  in  BSEP  II,  major  modifications  would  need  to  be  undertaken  in  the 
design  of  the  IE  program  and  the  BSEP  program.  Modifications  are  needed  in 
teacher  training  and  in  program  objectives,  content,  and  scheduling. 

The  teacher  trainers  should  make  special  efforts  to  assist  teachers  in  a 
number  of  areas--bridging  to  the  subject  matter;  using  the  cognitive  map  with 
students;  assisting  students  in  working  through  the  problems;  identifying 
students  having  problems,  particularly  in  bridging;  assisting  students  in  . 
applying  IE  skills  outside  the  classroom;'  and  identifying  the  concrete 
benefits  of  learning  IE. 

In  addition  to  greater  emphasis  on  certain  topics  in  IE,  several  options 
should  be  considered  for  the  organization  and  scheduling  of  the  training: 
including  teacher  trainers  who  have  used  IE  with  adult  students;  starting  and 
ending  the  training  sessions  on  time  and  including  definite  break  periods;  and 
conducting  the  training  session  during  vacation  breaks  when  teachers  are  not 
needed  in  the  classrooms. 

Several  options  were  suggested  by  teachers  for  modification  of  the  IE 
instruments  and  training  manuals:  revising  and  adapting  the  materials  for  the 
short  time  period  available  in  BSEP;  revising  and  adapting  the  materials  for 
adults;  providing  the  teachers  with  a  method  for  deciding  which  students  need 
IE  the  most;  developing  a  summary  or  guide  for  the  instructions  instrument; 
and  providing  some  summary  of  all  the  instruments. 

$6  .  •  •  ' 


All  of  these  rc-cc:-::.er.se tions  should  be  considered  in  ar.y  future 
implementation  of  IE  in  ESEP  or  in  other  parts  of  A ray  training. 

Any  future  implementation  of  IE  within  the  Army  should  also  be 
accompanied  by  an  evaluation  of  both  the  ircpelmentetion  and  .the  long  "term 
outcome.  As  a  result  of  the  present  demonstration,  a  variety  cf  procedures 
have  been  identified  that  r.uy  be  used  in  such  an  evaluation  for  examining  the 
implementation  as  well  as  the  outcomes  of  the  program.  These  procedures 
include  assessing  teacher  training,  conducting  classroom  observations, 
gathering  records  on  student  performance  on  IE  materials,  and  gathering  pre- 
and  post-measures  of  soldier  performance.  A  complete  evaluation  should 
include  a  longitudinal  assessment  of  soldiers'  performance,  since  the  greatest 
impact  of  the  Feuerstein  IE  program  is  not  expected  until  several  years  after 


its  conclusion. 
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Description  of  Tats  Collection  I nr trunen ts 


Measures 

Data  sources  . 

j 

Procedures 

developed 

Prior  to  an 

d  fol loving  instruct 

ion 

Pre-  anc  post-neasures  on  soldier 

s 

Standardized  tests 

GT  (subset  of  A3VAB) 

Soldier  records 

None 

TABE 

Soldier,  records 

None 

Test  of  cognitive 
functions 

Soldiers 

Development  of  tests 
(including  adaptation 
of  IE  instruments) 

Measures  of  teacher  training 

• 

Teacher  trainer  and 
supervisor  assessment 

Teacher  trainers 
and  tea'cher 
supervisor 

Teacher  preparation 
rating  form 

Teacher  assessment 

Teachers 

Teacher  reaction  to  IE 

Adequacy  of  materials 

Research  staff 

IE  materials  reviev 

Dur 

ing  instruction 

Record  of  exposure 

Teacher  records 
of  instruction 

None 

Teacher 

attendance  records 

**••>  v  a 
tlV«>C 

Performance  or.  IE 
xs  terials 

Completed  iE 
fores 

Done 

Self-evaluations 

Teachers 

Teachers  evaluations #  . 
of  IE  ns  terials.  •  • 

Observer  evaluations 

Research  staff 

Teacher  observation 
form  • 

F  requeue; 
(S\9) 


Table  k-2 

Teachers'  Respor.oses  to  Question,  ".that  is  th.-  co: ;t  important 
learned  during  the  IE  training  sessions?" 


Most  important  thing  learned 


"o*  materials  and  methods 

New  or  different  ways  of  teaching  3 

Availability  and  use  of  IE  instruments  2 

Bridging  (to  everyday  life  and  to  Army  life)  2 

Ways  of  organizing  instruction  1 

Method  for  getting  students  to  think  and  to  1 

talk  about  vh$t  they  are  doing 

Method  for  getting  students  to  talk  about  1 

implicit  versus  explicit  instructions 

New  concepts 

Flexibility'  of  the  mind  1 


Learning  left  from  right  is  a  cognitive  skill  1 
Re  inforcement 

Teaching  style  1 
L3 E?  students  can  be  helped  1 
Enthusiasm  fer  teaching 
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Indica  tor 


(:>9) 


Benefits  or  gains 

Increased  precision  in  giving  instructions 

Increased  flexibility  in  wording  of  instructions 

Increased  awareness  of  and  precision  with  written 
instructions 

Ability  to  recognize  new  situations 

Ability  to  adapt  traditional  methods  to  new 
situations 

Decrease  in  egocentric  behavior;  ability  to  view 
problem  from  another's  perspective 

Ability  to  generate  information 

Ability  to  use  points  of  reference 

Ability  to  read  maps 

Lack  of  benefits  or  gains 

::o  application  to  Arr.y  life 

Failure  to  apply  skill 


1 

1 

1 

1 

1 

1 

1 

1 

1 


Scheduling  and  organisation  of  training  sessions 

Scheduling  of  training  when  teachers  not  needed 
in  classrooms 

During  afternoon  (used  for  tutoring)  rather  than 
during  morning  (used  for  classes) 

During  vacation  break 
Better  organization  of  training 
Better  pacing  of  training 

Less  time  with  Organization  of  Dots  and  more 
time  with  later  instruments 
Starting  and  ending  sessions  on  time 
Inclusion  of  scheduled  break  times 
Reduction  in  time  spent  on  “highs  and  lows" 

More  attention  given  to  Army  adaptation 

Answers  given  to  questions  about  limited  time 
Instruction  and  practice  given  in  all  instruments 
(to  provide  broad  foundation) 

Revision  and  adaptation  of  materials  for  a  shorter 
time  period — 6  or  12  weeks  versus  two  years; 
reduce  number  of  instruments  presented  to 
soldiers  but  cover  them  more  thoroughly 

Revision  and  adaptation  of  materials  for  adults--changinr 
pictures  of  boys  into  soldiers  is  net  enough 
Trainers  who  have  worked  with  adults 

"ore  attention  or  effort  given  to  ether  IE  materials  and  t'rair.ir. 
Observation  of  classroom  teaching  or  teaching 
demonstrations  . 

Bridging  to  subject,  natter — break  into  sub ject-r.atter  group: 
Instruction  in  use  of  cognitive  map  with  students 
Method  for  deciding  which  students  need  IE  the  nest 

Other  suggestions 

Have  trainers  speak  mere  loudly 
Present  IE  in  positive  light  from  beginning 
Have  afternoon  bull  session  to  discuss  IE  after 
two  to  three  weeks  of  teaching 

Include  IE  as  part  of  Basic  Training  for  ever/one 
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Table  A-5 


Teachers'  Responses  to  Questions,  "Do  you  think  the  r. raining  was  adcou.ne  for 


this  exercies? 

What  problens 

have 

occurred  (or  do  you  expect  to  occur)  with 

it?" 

Inst  rument 

Page 

Cor.rent 

(N=9) 

Organization  of  Dots 

6,7 

Training  adequate;  no  problens 

4 

Objective  difficult  to  find  in  manual 

14 

No  bridging  in  manual 

Orientation  in 

Space  I 

12 

Training  adequate;  no  problems 

Instructions 

24 

No  teacher's  guide  for  instrument; 
need  a  summary  at  least 

39 

Students  may  not  understand  what  to 
do  with  it 

Nuraeticai  Progression 

13 

Students  may  not  be  able  to  apply 
formula 

35 

Page  not  covered  in  training 
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Table  A -£> 


Number  of  IF.  Pages  Observed  to  be  Presented  in  a  Three-and-one-l>alf-hour 


Instruct  ional  Dav  in  1961  and  1982  to  Pricarv  Analvsis  Group  -of  S'tudents 


Table  A-7 


Amount  of  Time  Observed  to  be  Spent  cn  IE  Lessons  in  a  Threc-ar.d-one-half-hour 
Instructional  Day,  anc  Tine  per  Pafe,  in  1951  ana  ‘'952 


Tine 

in  hours  and 

□i notes- -total 

(pace) 

- 

Tee c'n e  rs 

October 

(N  =  9) 

lioveober 

(N=8) 

December  ' 
(N=8) 

February- 

(11=5) 

Anrii 

(N=4) 

Team  1 

1  :33  (0:47) 

1:25  (0:14) 

1:27  (0:12) 

1:27  (0:15) 

0:50  (0:25) 

(n-3) 

Team  2 

1:21  (0:12) 

1:39  (0.20) 

1:18  (0:26) 

1 :02  (0:31 ) 

0:11  (0:04) 

(n=3) 

Team  3 

0:47  (0:16) 

0:34  (0:17) 

0:16-  (0:08) 

0:00  (0:00) 

0:00  (0:00) 

(n=3) 


Tabic  A-S 


of  Tice  Allocat 

ion  Early  and  Late  in  De: 

tons  trailer,  ir. 

’961  and  *9£2 

• 

j 

Phase 

.* 

% 

Independent 

Teachers 

Introduction 

wo  rk 

Di scussion 

Sun.  nary 

. 

Oc 

tober/Noveaber/Decenber 

(13*25) 

Team  1 

(n=3) 

42 

49 

7 

2 

Team  2 

33 

37 

28 

2 

(n-3) 

* 

Team  3 
(n=3) 

19 

45 

35 

1 

Weighted 

34 

44 

20 

2 

average 

February/April  (H*9) 

Team  1 

(n-3) 

23 

69 

7 

1 

Team2 

25 

53 

22 

A 

(n-3) 

• 

Tear.  3 

(n-3) 

0 

A 

O 

r 

V.'e  ighte.d 

64 

*.2 

• 

* 

average 

- 

65 


Frequency 


F  requency 


6  Pog«  ^0 


Table  A-l  2 

Teachers'  Positive  Crer.  Ended  Ccr.r.»>nts  E*.-ar:ir-  I"  ?rc- 


Consent 


.rreouency 

0>9> 


Effects  of  IE  on  students 

Students  liked  IE  ~ 

Students  enjoyed  pinvheel  game  (OSl)  1 

Students  liked  change  fron  subject  natter  1 

Students  liked  idea  of  cognitive  functions  1 

Students  became  nore  precise  in  instructions  and  improved  1 

in  communication  skills 

Students  applied  strategies  on  job  1 

Effects  of  IE  on  classroom  teaching 

Generated  discussion  and  interest  5 

Helps  in  teaching  vocabulary  1 

Helps  in  teaching  strategies  1 

Helps  teaching  inferences  1 

Fits  with  subject  matter  2 


Helps  "put  it  all  together"  I 

Is  good  for  teas  teaching  1 

Helps  promote  coordination  among  teachers  '  1 

Trains  teachers  to  teach  thinking  *  I 

Training  and  materials 

IS  ccncepts  and  theory,  such  as  teaching  strategies  and  5 

logical  reasoning,  are  good 

Teacher  trainers  provided  good  advice  or.  certain  I 

instruments 

Teacher’s  manual  provides  preparation  in  theory  ,•  1 

Instruments  are  good  .  .  i 
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7  a  M*  a-I  3 

T  r  #  { Stfjinvt  Q^e  n  tr.e«d  C  <v-  »  l»<»rdtr.c  H  n  *->**- 


T  r  esuency 
( N  -  9) 


Student  reaction* 

Student*  don't  1  IK*  It;  don't  want  lo  be  ‘bothered*  with  it; 
re  fun  to  de  It 

Studtntt  one  need  It  sot'  »tc  to  freer.'.  It  no»  t  ;  thoie  v*-.o 
found  it  Kurd  had  netativc  cxvnu 

S  tuCrr.'.i  tc  tx  ii«(4l  >vt  Uc«uit  o!  conctrr  wi  n,  u.  *nc 

CCD  itoru  . 

StuCentt  appear  to  be  negative  beeaui*  of  "1  of  mit  ruaeoii 

Student*  art  bored  v“lth  It  after  novelty  n**  uorn  oil 
Student*  reacted  to  1L  •  *  If  it  ^r‘l  “kid  livff" 

Student*  don't  lik*  repetition  of  Analytic  Perception 
Student*  don't  111*  Orgarlxatlon  of  Dot*  «nd  Orientation  in  Spec* 
Effect*  on  student* 

Ko  *tuoent  laproveaent  wbi  observed 
Skill  transfer  va*  generally  lowing 

IE  didn't  seen  to  alleviate  lesmlry  disability  proble-s 
Teichlry  and  classroom  problems 
Lack  of  t  Ice  1*  problec 
Lead*  to  added  homework. 

Lead*  to  getting  behind  In  turret  oatltt 
Traiul  t  loo  between  IE  *»sd  *ubjeci  «-Jtter  always  lo*e*  *tudent» 
Bridging  1*  difficult 

Br  losing  to  tngliah  l*  e*t*clally  dlfllcwlt 
br  id  f  l  iv£  to  Aray  1*  difficult 

IE  created  scoe  Inflexibility  {  lr.  tying  several  classes  tofttr.er} 
Tice  can  tx  tetter  spxn:  on  subject  c-»tter  !r-»l  ru::lo" 

Training  and  cater  la]  f 

Orientation  m  Space  1  1*  not  needed  for  th.s  f  row; 

loti  furen'.*  are  tot.  lor^-  have  ;oc  c-*:.^  page*,  especially 
Organization  of  »k>i*  ',r»truc;io:j 

There  appear*  co  be  0o  transfer  to  «-*  t  r. ,  for  fioc 

Orgar.ltatlon  of  Dot* 

1E‘*  esphasl*  or.  adult/thlld  or  1  e  *c  e  r  /  t  o  1 1  owe  r  rt  J  *t  lontM; 
poses  propiez*  for  teacMry  acvltt 

IE  doe*  net  appear  tc  br  octivsnry  tu  student* 

7f-tr*  ;*  r-o  good  tie  between  Ins*,  t  uzc*. :  s  ar.d  ht  functions 

IE  doei  not  blend  wel]  wttr  science  tcrr!cuj«i 
1C  dees  oot  hav#  anytMry  on  listening  **111* 

Teacher'*  can-jal  l*  puor 

Training  t  Ibr  was  sotted  in  discussions  ef  .'M(-*s  an;  levs' 

Teechers  >^rf  co'.f  u*t.J  wltr.  regard  tc  »*-#:  «— »  r«Cvi.-ed 
In  pregraz 
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Cha  nge 


Frequency 
(K  -  S>' 


Traini ng 

Trainers  should  give  oo re  feedback  on  classroon  observations 


Cltariy  Ce lined  goals,  definitions,  instructions,  and  1 

schedule  needed 

Trainers  should  observe  classroocs  oore  often  1 

Teacher's  manual 

More  practical  and- good  ideas  needed  4 

better  editing,  including  correction  of  errors,  3 

ci slnfomatlon,  typos,  and  organization,  needed 

More  and  better  bridging  to  subject  carter  needed  3 

Better  bridging  to  Amy,  to  ilOSs,  needed  1 

Better  sections  on  military  needed  1 

Instruments 

They  should  be  shorter--have  fever  pages,  include  only  5 

three  or  four  pages  per  instruoent 

They  need  to  be  oodifled  tor  adults  4 

They  look  too  eleoentary,  especially  Orientation  in  Space  3 

1  and  Illustrations 

They  need  better  organization  1 

They  should  be  reviewed  by  ollltary  staff  to  be  oad*  1 


nor*  Amy-relevant 

Orientation  m  Space  1  is  not  needed  for  this  group 
Orientation  in  Space  111  needs  revisions 
lcpieae.ntat  ion 

Longer  period  of  tine  needed  for  program 

It  would  be  better  to  present  1 1  in  basic  Training  or 
I  or  junior  high  school 


It  should  be  oriented  toward  individual  diagnosis 


r.-ToU-  A- 1  5 


Changes  in  Student  Behavior  Observed  by  Teachc-rs  in  Teams  1  and  2 


Change  Frequency 

Increased  participation  in  oral  discussion  li 

Improved  use  of  vocabulary  and  concepts  taught  in  class  K 

Improved  ability  co  follow  directions  13 

Improved  ability  to  solve  problems  in  class  12 

Increased  attention  span  and  concentration  on  casks  11 

Improved  ability  to  learn  new  tasks  10 

Increased  enthusiasm  for  learning  10 

Increased  responsibility  for  making  up  own  work  10 

Increased  volunteering  for  additional  learning  or  9 

problem  solving  tasks 

Increased  checking  of  own  work  9 


Increased  relevance  and  completeness  of  answers 
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Coprutive  Skills  tcats-prctest.  poattnst 


«—  c  c 
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V  C 
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C  £ 
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.Lie-  A- 17 


:rt-P ost  Correlations  of  Cognitive  Skills, 


est  Scores 


Test 

Correlation 

Cognitive  Skills 

Kap  Reading 

.41 

Identification  of  Problem  Dimensions 

•  55 

Ordering 

.79 

Use  of  Common  Objects 

.58 

Cognitive  Vocabulary 

.55 

Generation  of  Problem  Solutions 

.34 

Total  Cognitive  3attery  _  1 

.56 

• 

IS 

Comparisons 

.40 

Illustrations 

— 

Instructions 

.56 

Orientation  in  Space  III 

.62 

Analytic  Perception 

.29 

Orientation  in  Space  I 

.25 

Numerical  Progression 

.43 

Categorization 

.20 

-  ’ 

Organization  of  Dots 

.29 

Total  IE  Battery 

.59 

* 

TABS 

Reading  Vocabulary 

.65 

Reading  Comprehension 

•  55 

* 

Reading  Total 

.67 

- 

Math  Computation 

.76 

• 

Math  Concerts  anc  Problems 

.67 

* 

Math  Total 

.66 

Language  Mechancis  and  Expression 

-  .57 

Spelling 

.76 

# 

Total  ?A32  Battery 

.67 

- 

CT 

• 

GT 

•  52 

• 

• 

i  • 

«  .  *  ^  •  «  L.i  **»■»•  W*fc*«*k  •**•*.*  «^«  •  •  *  • 


•  »-*-».»  -  i  -  «  » 

.  •■  \‘  */  V  %•  V  •. 

,*7^  -p.V  ’/  .v.  v*7-“'.. 


•.*  V  S1  \*  \/P«/  \ 
■  \  ■*  V.  v«V  ;/> 


%;* 

.V 


T-a  bio  A-l  8 


Co  r  ic  1  a  r.  i  ons  of  TAKE  and  CT  iCurcb 


Test 

Corre 

la  t  ion 

Pre-CT 
(  r.=  S9) 

Post-CT 

(n=84) 

( Po£  r-Gt 
with  Pre-TAEE) 

Reading  Vocabulary 

.22 

.96 

.9<, 

Reading  Coraprehe ns  ion 

.23 

.59 

.31 

Reading  Total 

.28 

.59 

.95 

Math  Cooputation 

-.05 

.  70 

.62 

Math  Concepts  and  Problems 

.09 

.79 

.52 

Math  Total 

.07 

.76 

.61 

Language  Mechanics  and  Expression 

.16 

.28 

.06 

Spelling 

.15 

.30 

.92 

Total  TABE  battery  score 

.17 

.6  9 

.59 

Avr-rn,-*  .20,  .A)  .34,-10 


IK  Tc:it  scores  irMi«tinC  proportions  of  correct  responses 
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S Lib  trac  cion : 


addition: 


These  examples  shew  that  the  stucenc  can  chec'^  his  or  her  work  in  sub¬ 
traction  by  adding  the  parts  to  see  if  they  equal  the  whole.  Similarly, 
he  or  she  can  check  work  in  addition  by  subtracting  one  part  from  the 
whole  to  see  if  it  equals  the  other  part. 

Introduce  rows  1-4  on  page  11  of  the  Basic  Essentials  of  Mathematics 
(Part  1).  Have  students  complete  the  problems  and  discuss  cheo.  Ask  how 
they  checked  their  work. 

Turn  to  page  11  (or  1 2  or  13)  of  Organization  of  Dots.  Eave  the  students 
cocplete  one  row  of  frames.  Then  ask  then  to  think  about  different  wavs  oi 
checking  whether  their  answer  is  correct.  Identify  as  many  different 
strategies  as  possible  for  checking  the  work.  Have  the  students  complete 
the  next  row.  Ask  then  to  exchange  booklets  and  to  check  their  neighbor's 


work. 


End  the  class  with  a  discussion  on  the  importance  of  checking 


one's  work. 


LESSON  ? 


Essential  Skills  (look  16) 


Objective :  Students  --ill  learn  strategies  fcr  scanning  written  naterial 

and  for  identifying  the  critical  components. 

Eave  the  students  turn  to  page  28  in  Essential  Skills  Qook  16)  .  '  for 

the  title — "Don't  be  Snowbound."  What  does  this  suggest  about  the  contents  of 
the  passage?  Get  as  many  ideas  as  possible. 

New  ask  the  students  to  spend  a  few  seconds  scanning  the  passage.  What 
topics  are  mentioned  in  Che  paragraph?  Hake  a  list.  What  sight  be  the  caia 
idea  of  the  passage?  Get  as  many  suggestions  as  possible,  and  list  then  on 
the  board. 

Next,  ask  the  students  to  read  the  entire  passage  and  to  answer  the 
questions.  Discuss  each  question  and  its  answer.  End  the  discussion  by 
returning  to  the  listings  of  topics  and  main  idea.  Which  ones  are  appropriate? 

Then  ask  about  -the  title  again.  How  does  it  help  us  to  identify  the 
topic  and  the  main  idea  of  the  passage?  Eov  does  the  scanning  of  the  passage 
help  to  set  the  framework?  These  .are  strategies  that  can  be  used  when 
beginning  to  read  new  material. 

Turn  to .page  10  (or  .14)  of  Instructions.  How  can  we  apply  these  strategies? 
As  the  student  scans  the  page,  what  does  he  or  she  see  first,  second,  third, 
fourth,  fifth,  and  so  forth?  Hake  a  list  of  these  items  on  the  board.  Ask 
the  students  to  summarize  the  instructions.  Then  'nave  them  complete  two 
revs .  What  kinds  cf  answers  did  the  students  suggest?  Which  ones  seered 
most  appropriate?  If  there  is  tine,  have  the  students  complete  the  page 
and  check  with  each  otner. 

Finally,  ask  one  of  the  students  to  summarize  the  strategies  that  can  be 
used  when  reading  any  material. 
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What  we  have  graphed  is  the  slope  of  Figure  IT 

Now  discuss  the  notion  of  a  progressive  tar: — '-here  you  pa/  a  larger 
percentage  of  your  incooe  for  taxes  as  your  income  increases.  What  would 
be  the  opposite  of  a  progressive  tax — a  regressive  tax.  Ask  for  a  definition 
and  for  sene  exanples . 

Work  through  a  case,  for  example  using  sales  tax.  Assume  that  sales 
tax  is  5".  Tnus,  everybody,  regardless  of  income,  is  taxed  at  the  sane 
rate.  Fight?  Hut,  let's  see  the  effect  of  this  tax  or.  r-o  families: 
the  Smith  and  Jones  families.  Certain  items,  such  as  toed,  are  considered  . 
to  be  basic  necessities.  This  means  that  people  must  s'per.c  at  least  a 
certain  amount  to  survive.  Let  us  assume  that  a  minimal  amount  that  a- 
family  of  four  must  spend  on  food  is  SI, 000  per  year.  The  Smiths  spend 
51,000  per  year  cn  food,  as  co  the  Joneses.  Hut  the  Smiths  have  an  income 
of  350,000,  while  the  Joneses  have  an  income  of  $25,000. 
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Smiths  Joneses 

530,000  S25,OGG 

$  1,000  S  1,000 

05  x  SI, GOO  *  $50  .05  x  $1,000  =  S50 

Percentage  of  income 

paid  in  sales  tax  S 50/$ 50 , 000= . 001  $ 50/ $ 25 , 000= .002 

Thus,  the  Jooses,  who  have  a  smaller  income,  pay  a  higher  oerc 
income  on  sales  tax.  Hew  could  this  be  graphed  to  shev  that  s 


Income 

Food  expenses 
Sales  tax 


re  eressive? 


appendix  c 
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(devisee) 

This  is  a  ces:  :c  see  hew  veil  ycu  <r.o'-'  certain  skills  'hat  are  :c  :c 
taught  it  the  In  s  tr^ter.t  a  I  Ir.  rl  £"er.t  Program.  The  Ir.  strjrettii  enrichment 
program  is  being  tried  out  as  a  part  cf  tr. e  Basic  Skills  education  Program 
( BSZ?  II)  at  Port  Knox. 

The  resulcs  of  your  work  ct  this  test  vill  ce  used  as  part  of  the 
.evaluation  of  the  Instrumental  enrichment  Program.  The  evaluation  vill  assess 
the  effectiveness  of  the  program  and  recommend  improvements  that  are  needed. 


PRINT  YOUR  NAJhl 


TOUR  RANK 


a  :ecc-;iissa;ce  ni<s 
(  Be  i  e  r  :  o  this  --he-  a 


-escribe  the  location  c:  cr 


As  suzie  char  you  are  inside  the  Business  College  facing  the  Fell  River 
Which  building  is  to  your  right? 

a.  High  School 
t .  Factor; 

c.  Church 

d.  None  of  the  above 


Assume  chit  your  are  walking  .along  the  Fell  River  from  the  Business 
College  to  the  Fire  Station.  In  vha t  direction  are  you  walking? 

a.  Northeast 

b.  North 
c  .  Fast 

a.  Northwest 


Your  are  aew  on  Main  Street  facing  the  Post  Office.  What  building. is 
your  right? 

a“.  Drag  Store 

b.  Fire  Station 

c.  Office  Building  9U 

d.  City  Hall 


You  climb  the  steps  of  the  Post  Office  ar.d  thee  turn 
Street.  Describe  what  vou  vculc  see. 


arounc  to  race  .v 


Froa  the  Main  Street  entrance  tc  the  Drug  Store  you  a  1  >  to  the  ha: 
Street  entrance  to  the  Fire  Station.  In  -hat  direction  are  you  -a 

a.  North 

b.  Southwest 
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e  C2  guard  duty  i  n  a  cnnba  z  zcze . 


near  sc:ec:e  ap ;r c  cd  ng 


>our  pc  s  i  :icn  -  The  relieving  is  a  list 


c:  ic riens,  he;  they  £rE  ; -  --e 


'■reng  order. 


-**-t  tr.en  into  tr.e  correct  crcer. 


W'rocz  Order 


Correct  Order 


Again  you  order  “Haiti" 
Stranger  gives  the  password. 
Ycu  ask  “Vno  is  there?” 


You  order  “Halt!" 

Stranger  identifies  hinselr  . 

You  order  “Advance  to  be  recognized. 
You  give  permission  to  pass. 

You  ask  for  the  password. 


You  have  cone  upen  a  soldier  with  a  bleeding  wound  in  his  leg.  You  put 
on  a  field  dressing  and  a  pressure  dressing,  but  the  bleeding  did  not 
stop.  xhe  following  are  jthe  steps  in  putting  on  a  coumicuet,  hue  the v 
are  in  the  wrong  order.  Put  then  into  the  correct  order. 


Wrong  Order 

Put  a  stick  under  the  knot. 


Correct  Order 


1.  i 


Get  nedical  help. 


Get  the  soldier's  belt.  . 


Tie  one  end  of  the  stick  down 
so  it  will  net  unwind. 


ia*.e  a  T  cn  his  tcrer.eac  with 
a  grease  pencil. 

Place  the  belt  close  to  the  wound 
between  the  wcur.c  and  his  heart. 


Tie  a  knot  in  the  belt. 

Twist  che  stick  just  enough  to 
stop  the  bleeding. 

Find  a  stick. 


Sometimes  ycu  nay  be  ic  the  field,  ir.;  ycu  say  seed  something  :h;:  is  -.o: 
3vaiiable .  Fc r  example,  ycu  have  to  stay  is  the  fieic  -  t  might  is  the 


rais,  but  ycu  have  neither  a  test  sc r  a  grcusc  cloth.  Is  this  css 
could  use  a  tais  poschc  as  a  substitute  f c:  the  test  or  the  ground 
cloth.  Thus,  the  rais  poscho  has  several  uses  is  the  field.' 


s  case,  you 


Ites 


rais  poscho 


Uses  is  the  Field 
* 

rais  coat ,  test , 
grouse  clctr 


V rite  as  sasy  uses  is  the  rielc  as  ycu  cas  ter  tse  toaiovisg  itess, 


Uses  is  the  Field 


Ices 


shoe  string 


baseball  car 


In'  each  row  below,  circie'Che  word  or  phrase  on  the  right  that  is  closest 
is  seaming  to  the  word  on  the  left.  Tor  example: 

little  -a. "big  b-  child  c.  snail  "  d.  ycung 

The  correct  answer  was  "snail." 


systematic 


iccuracy 


strategy 


by so  thesis 


cirty 


b -  automatic  c.  orderly 


a.  exactness  b.  mistake  c.  rigicit? 


cleversess  o.  speec 


b .  lav 


c.  wart are 


c  .  assumotios 


c.  ctsarrav 


c  .  tc  t  or;  s : 


c  .  e’.sceme 


eras sitv 


s imilari cy 


ittrib  ute 


orientatics 


orgasite 


a.  s nose 


5.  pr.ocsgrann  c.  -t:e: 


a.  liKeness  o.  current  c.  citrerence 


c .  center 


c.  scucy 


b.  adniratics  c.  characteristic  c .  sensation 


..  race 


b.  circle 


c  .  roister 


a.  shuffle  b.  arrange  c.  finish 


c .  cirenticn 


c.  sine 
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APPENDIX  E 

Classroom  Observation  Form 
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•ail  l*fci 


DEMONSTRATION  Ot  INST?. UMZXTA1  IDCRI  CEMENT  PROGRAM 

basic  skills  education  program  —  port  engi 

Classrooa  Observation  :ora 


Teacher  name  _ 

Subject  _ _ 

Date _ 

Time  at  beginning  of  class  _ 

1.  Number  of  students  in  class 


RET 

A- Analytic 
perception 

3-3ridging 

C -Checkin  g 

E- Explanation, o 
alternatives 


2.  Arrangement  of  students'  desks. 


2.  Instrument  and  pages  covered 


3.  Major  points  aade  in  I. I.  instruction, 
a.  Introduction 

Time  began  _ _ 

Questions  asked  by  teacher  (check  all  chat  were  used) 

_  1.  What  do  you  see  on  the  page/or  on  the  first  tvo  rows,  of  the 

page? 

_  2.  Vhat  looks  familiar  to  you? 

_  3.  What  is  "new'  on  the  page? 

_  4.  what  vocabulary  or  words  do  ve  need  to  discuss  this  page? 

_  5.  what  cues  indicate  the  directions  for  starting  the  page  cr 

for  doing  the  exercises?  (If  there  ere  printed  1 nstruc ciccs , 
teacher  should  focus  on  key  words  and  main  ideas.) 

_  6.  How  can  we  check  cur  work  to  eliminate  possible  errors.'’ 

7.  Other: 


L-Labels 

0-Ordering  of 
steps 

P-Perspectives 

R-Reasooing 

S-Strategry 


Majcr  points 


Time  ended 
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iMti 


(Classroom  Observation  “cm,  ccct'd.) 


b  •  Independent  -ork 

line  began  _ 

Teacher  activities  (check  all  that  «ere  used) 

_  1.  Coes  frcn  student  to  student  and  observe  vork. 

2.  Offers  individualized  assistance. 

_  3.  Painicrces  successful  mastery*  ' 

_  A.  Initiates  discussion  of  problems  vith  individual  students  or 

s-iveral  students  together. 

5 .  C  tber  : 


Student  activities  (check  all  that  apply) 

_  1.  Works  individually 

_  2.  Checks  responses  vith  others 

_  3.  Offers  assistance  to  others 

A.  Other: 


line  ended  _ 

c.  Discussion 

Time  began  _ 

Questions  asked  by  teacher  (check  all  that  vere  used) 

_  1.  What  strategies  did  va  use  to  solve  these  problems? 

_  2.  Was  one  strategy  core  appropriate  chan  another? 

_  3.  Which  tasks  vere  cost  difficult?  Why? 

_  A.  Think  cf  an  example  cf  bcv  what  ’*'«  vere  doing  cn  cbe  page 

relates  to  our  daily  lives  and/cr  problems  related  to  learning 
teach,  science,  art  ox  nus  i  c ,  etc. 

5 .  Other  : 


Bridges  suggested 
3y  teacher  - 

5y  students  - 

Major  points 

lira  encec  _ 
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1  .T-Jp.-'.  p,  HStpyir; 


(Classrooa  Observation  ?orm,  cent'd.) 


d.  Sumary 
Tine  began 

Restatement  of  objectives 
Student  evaluation 
Time  ended  _ 

e.  Vocabulary  list: 


A.  Classrooa  atmosphere  (Record  posicive  or  negative  examples  in  the  following 
area  s) 

Cooperation  among  students 
Participation  in  discussion 
Attention  to  discussion 

5.  Problea  areas  for  students. 


student  interest  in  I- 1.  materials . 
Very  interested 
Int  ere  sted 
Mildly  interested 
Somewhat  uninterested 
Definitely  uninterested 

7.  Suggestions  for  improvements  in  materials. 


6 .  Leve 1  of 

_ 5. 

_ 4  . 

2  . 
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